-- Logs begin at Thu 2022-09-22 17:44:41 UTC, end at Thu 2022-09-22 18:47:06 UTC. -- Sep 22 18:10:41.401870 dv-cinder-858946-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 22 18:10:41.409640 dv-cinder-858946-1-smb devstack@keystone.service[81334]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 22 18:10:41.411663 dv-cinder-858946-1-smb devstack@keystone.service[81334]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 18:10:41 2022] *** Sep 22 18:10:41.411663 dv-cinder-858946-1-smb devstack@keystone.service[81334]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 18:10:41.411663 dv-cinder-858946-1-smb devstack@keystone.service[81334]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 18:10:41.411663 dv-cinder-858946-1-smb devstack@keystone.service[81334]: nodename: dv-cinder-858946-1-smb Sep 22 18:10:41.411663 dv-cinder-858946-1-smb devstack@keystone.service[81334]: machine: x86_64 Sep 22 18:10:41.411663 dv-cinder-858946-1-smb devstack@keystone.service[81334]: clock source: unix Sep 22 18:10:41.411663 dv-cinder-858946-1-smb devstack@keystone.service[81334]: pcre jit disabled Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: detected number of CPU cores: 4 Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: current working directory: / Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: detected binary path: /usr/bin/uwsgi-core Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: your processes number limit is 47680 Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: your memory page size is 4096 bytes Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: detected max file descriptor number: 2048 Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: lock engine: pthread robust mutexes Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: thunder lock: enabled Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 22 18:10:41.412099 dv-cinder-858946-1-smb devstack@keystone.service[81334]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 18:10:41.452888 dv-cinder-858946-1-smb devstack@keystone.service[81334]: Python main interpreter initialized at 0x56378757a9c0 Sep 22 18:10:41.452888 dv-cinder-858946-1-smb devstack@keystone.service[81334]: python threads support enabled Sep 22 18:10:41.452888 dv-cinder-858946-1-smb devstack@keystone.service[81334]: your server socket listen backlog is limited to 100 connections Sep 22 18:10:41.452888 dv-cinder-858946-1-smb devstack@keystone.service[81334]: your mercy for graceful operations on workers is 90 seconds Sep 22 18:10:41.453368 dv-cinder-858946-1-smb devstack@keystone.service[81334]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 18:10:41.453368 dv-cinder-858946-1-smb devstack@keystone.service[81334]: *** Operational MODE: preforking *** Sep 22 18:10:41.453649 dv-cinder-858946-1-smb devstack@keystone.service[81334]: *** uWSGI is running in multiple interpreter mode *** Sep 22 18:10:41.453649 dv-cinder-858946-1-smb devstack@keystone.service[81334]: spawned uWSGI master process (pid: 81334) Sep 22 18:10:41.453855 dv-cinder-858946-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 22 18:10:41.454703 dv-cinder-858946-1-smb devstack@keystone.service[81334]: spawned uWSGI worker 1 (pid: 81342, cores: 1) Sep 22 18:10:41.454795 dv-cinder-858946-1-smb devstack@keystone.service[81334]: spawned uWSGI worker 2 (pid: 81343, cores: 1) Sep 22 18:10:41.455776 dv-cinder-858946-1-smb devstack@keystone.service[81334]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 18:10:45.783439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 18:10:45.783439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: from cryptography.utils import int_from_bytes Sep 22 18:10:45.784238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 18:10:45.784238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: from cryptography.utils import int_from_bytes Sep 22 18:10:45.784683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 18:10:45.784683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: from cryptography.utils import int_from_bytes Sep 22 18:10:45.784817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 18:10:45.784817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: from cryptography.utils import int_from_bytes Sep 22 18:10:45.834007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 18:10:45.834208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 18:10:45.834336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 18:10:45.834433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] command line args: [] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 18:10:45.834517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 18:10:45.834633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 18:10:45.834724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] command line args: [] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 18:10:45.834803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ================================================================================ {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 18:10:45.834974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 18:10:45.835060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] admin_token = **** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.835138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ================================================================================ {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 18:10:45.835284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] config_dir = [] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.835406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] admin_token = **** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.835509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.835642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] config_source = [] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.835721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] config_dir = [] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.835822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] debug = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.835914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.835988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] config_source = [] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.836063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.836277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] debug = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.836398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.836533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.836533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.836729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.836825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.836932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] list_limit = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] log_config_append = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] list_limit = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] log_config_append = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] log_dir = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.837985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] log_file = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] log_dir = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838400 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] log_file = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.838963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.839086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.839169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.839248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.839377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.839454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.839577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.839653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.839776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.839861 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.840014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.840235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.840317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.840472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.840599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.840705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.840796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.840953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.841031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.841198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.841352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.841499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.841591 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.841778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.842003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.842187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] publish_errors = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.842285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.842423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.842501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] publish_errors = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.842653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.842781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.842863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.843448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.843602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.843687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.843838 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.843924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.844073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] standard_threads = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.844152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.844304 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.844391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] standard_threads = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.844547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.844644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.844722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.844799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.844871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] use_journal = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] use_json = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] use_journal = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] use_stderr = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] use_json = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] use_syslog = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] use_stderr = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] use_syslog = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 18:10:45.845963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.846122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.846208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.846379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.846456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.846617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.846701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.846864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.846954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.847100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.847180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.847349 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.847436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.847586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.847672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.847832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.847911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.848079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.848157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.848328 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.848414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.848563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.848646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.848810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.848894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.849046 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.849143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.849313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.849395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.849562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.849650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.849798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.849885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.850035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.850112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.850289 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.850366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.850537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.850618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.850774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.851025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.851103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.851292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.851473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.851554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.851772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.851943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.852026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.852225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.852429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.852511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.852680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.852906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.852992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.853163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.853418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.853501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.853648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.853878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.854011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.854125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.854317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.854400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.854595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.854757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.854889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.855050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.855185 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.855310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.855505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.855653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.855773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.855950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.856156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.856302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.856440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.856571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.856704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.856833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.856978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.857109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.857315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.857435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.857579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.857709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.857951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.857951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.858099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.858099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.858211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.858269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.858480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.859269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.859509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.859748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.859992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.860132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.860279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.860413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.860547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.860678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.860811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.860945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.861092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.861222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.861409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.861544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.861683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.861825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.861961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.862060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.862138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.862250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.862332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.862332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.862536 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.862776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.862932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.863012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.863181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.863271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.863455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.863537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.863703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.863783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.863943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.864031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.864183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.864277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.864423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.864510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.864683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.864806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.865013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.865409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.865409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.865807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.865947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.866080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.866158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.866287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.866366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.866366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.866366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.866659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.866844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.867084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.867323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.867576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.867819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.868060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.868196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.868333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.868472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.868597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.868720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.868805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.868969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.869062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.869226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.869320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.869487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.869610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.869727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.869816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.869967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.870056 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.870217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.870299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.870461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.870551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.870702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.870786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.870944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.871026 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.871182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.871272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.871426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.871508 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.871665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.871905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.872143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.872378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.872612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.872845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.873083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.873339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.873585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.873824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.873970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.874075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.874356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.874440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.874616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.874696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.874879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.874960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.875122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.875201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.875357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] auth.external = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.875436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.875592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.875672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.875847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.875927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.876081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.876160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.876315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.876395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] auth.password = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.876549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.876630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] auth.token = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.876787 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.876865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.877019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.877109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.877282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.877412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.877520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.877600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.877766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.877845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.878006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.878089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.878239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.878317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.878479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] credential.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.878566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.878729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.878819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.878959 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] auth.external = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.879039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.879199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.879278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.879450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.879531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.879699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.879779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.879937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.880016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] auth.password = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.880165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] auth.token = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.880246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.880406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.880486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.880643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.880723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.880889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.880970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.881123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.881202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.881393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.881474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.881641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.881723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.881874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.882089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.882170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] credential.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.882341 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.882429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.882590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.882677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] federation.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.882830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.882909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.883073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.883161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.883317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.883399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.883547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.883626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.883789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.883881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.884028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.884107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.884263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.884342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.884510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.884590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.884766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.884847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.885006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.885087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.885305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.885481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.885616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.885744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.885874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.885997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.885997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] federation.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.886257 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.886336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.886397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.886457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.886516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.886693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.886777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.886922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.887013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.887160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.887242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.887389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.887454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.887636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.887719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.887877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.887958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.888112 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.888296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.888452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.888515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.888676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.888790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.889002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.889143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.889297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.889499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.889638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.889806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.889970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.889970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.890219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.890348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.890629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.890713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.890840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.890971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.891184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.891269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.891444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.891519 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.891707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.891771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.891771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.892003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.892076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.892138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.892206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.892305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.892573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.892702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.892919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.893043 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.893182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.893347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.893487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.893626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.893756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.893883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894147 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.894988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.895079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.895144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.895284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.895380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.895526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.895685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.895917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.896043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.896172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.896299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.896382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.896444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.896615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.896742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.896881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.897009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.897153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.897302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.897455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.897589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.897710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.897788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.897848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.898023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.898101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.898360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.898456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.898530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.898654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.898790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.898881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.898987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.899121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.899235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.899364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.899475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.899605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.899709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.899849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.899949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.900088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.900188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.900369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.900441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.900692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.900780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.900886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.901132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.901315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.901399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.901578 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.901658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.901818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.901898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.902074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.902157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.902326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.902406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.902563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.902650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.902802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.902883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.903037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.903116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.903268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.903347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.903511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.903592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.903771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.903852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.904006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.904086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.904254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.904336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.904486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.904574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.904733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.904814 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.904968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.905049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.905199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.905300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.905993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.906080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.906251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.906332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.906497 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.906624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.906729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.906809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.906971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.907057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.907214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] resource.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.907294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.907466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.907546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.907714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.907795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.907950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.908029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.908180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.908259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.908440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.908521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.908675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.908754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.908922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.909035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.909154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.909261 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.909418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.909501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.909656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] role.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.909738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.909902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.909985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] role.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.910131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.910210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.910383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.910463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.910617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.910700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.910863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.910944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.911100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.911191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.911336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.911417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.911573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.911654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.911818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.911973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.912051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.912123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.912276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.912358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.912513 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.912608 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.912755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] resource.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.912836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.912999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.913079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.913265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.913360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.913499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.913700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.913780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.913940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.914021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.914191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.914274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.914435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.914515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.914672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.914752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.914913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.914995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.915145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.915226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] role.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.915389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] role.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.915468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.915619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.915701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.915866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.915946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.916104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.916184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.916337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.916420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.916569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.916650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.916812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.916891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.917057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.917140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.917324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.917408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.917565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.917659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.917796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.917876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.918028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.918114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.918267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] token.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.918357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.918507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.918588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.918748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.918828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.918985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.919177 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.919260 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.919413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.919494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.919660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.919741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.919907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.919988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.920152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.920232 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.920401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.920489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.920628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.920710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.920865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.920944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.921673 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.921829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.921944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.922022 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.922188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.922269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.922415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.922495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.922649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.922743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.922898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.922979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.923153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.923234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.connection = **** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.923396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.923486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.923630 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.923711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.923866 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.923947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.924096 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.924185 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.924377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] token.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.924467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.924565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.924646 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.924803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.924901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.925036 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.925120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.925299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.925382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.925539 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.925633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.925773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.925854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.926012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.926092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.926252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.926340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.926487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.926567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.926720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.926799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.926951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.927037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.927195 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.927322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.927430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.927512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.927605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 18:10:45.927740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.927920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.928162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.928426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.928683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.connection = **** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.928932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.929177 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.929438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.929676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.929908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.930143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.930376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.930610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.930853 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.931088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.931330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.931564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.931809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.932064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.932329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.932561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.932799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.933031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 18:10:45.933202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 18:10:45.957756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.957988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.958219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.958790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.959024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.959250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.966663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.967485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.995679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.995910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.996714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:45.997133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.050103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.050280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.099315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.099548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.099811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.100052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.261744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.261912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.262967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.286705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.286863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.287967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.288059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.299859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.299965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.312524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.312751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.312942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.313039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.313176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.313277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.313420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.313504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.313632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.313717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.313843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.313927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.314065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.314284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81342) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 18:10:46.330386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.330594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 18:10:46.330934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.331017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.331135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 18:10:46.331235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 18:10:46.331409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.331561 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.331671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.331755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 18:10:46.331928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.332011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.332182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.332525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.332795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.333056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.341932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.342212 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.342482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.342601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.342765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.343408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.343692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.343976 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.350216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.350943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.353075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.353395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.353680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.353853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.353962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.354138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.354232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.354424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.354506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.354708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.354790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.354994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.355076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.355259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.355338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.355526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.355615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.355795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.355876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.356064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.356341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.356612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.378874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.379783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.380342 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.380644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.381261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.381568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.385378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.385702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.385942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.386320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.386608 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.386896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.392316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.392603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.393332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.393622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.398244 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.398532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.398817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.399100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.399235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.399377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.399535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.399652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.399835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.399915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.400128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.400210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.400408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.400685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.400955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.401226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.416163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.416459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.417086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.417406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.420638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.421393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.423919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.424219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.424574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.424878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.428338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.429027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.431384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.432238 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.434614 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.434916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.435203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.435474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.435559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.435769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.435861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.436057 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.436140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.436346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.437172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.437495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.452960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.453273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.453550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.453714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.453801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.454014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.454288 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.454553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.460851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.461629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.462403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.463169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.463925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.464202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.464697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.464976 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.466904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.467193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.467484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.467701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.467784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.468016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.468171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.468306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.468594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.468992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.479191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.479480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.479765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.480047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.480144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.480337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.480422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.480625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.480709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.480917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.481010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.481331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.481629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.481914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.496123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.497141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.499040 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.500595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.502462 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.503640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.503955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.505063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.505449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.505734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.506127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.506554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.506841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.507234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.512453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.513565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.513961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.516464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.517450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.517844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.518133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.518414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.519403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.519802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.520095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.520380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.526156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.526450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.526733 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.528160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.528465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.528752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.533881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.534280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.534566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.534843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.535119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.535392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.535666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.535959 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.536267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.536540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.536643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81342) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 18:10:46.536804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.537070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.537166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.537358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.537601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.537697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.538081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.538574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.539069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.539575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.540053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.540549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.541082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.541725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.542068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.542354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.542641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81342) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 18:10:46.579682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56378757a9c0 pid: 81343 (default app) Sep 22 18:10:46.581386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56378757a9c0 pid: 81342 (default app) Sep 22 18:10:46.583446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00581-d408-4164-bcf2-82f8109a844d None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:46.583737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00581-d408-4164-bcf2-82f8109a844d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:46.584011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00581-d408-4164-bcf2-82f8109a844d None None] PATH_INFO: `/v3` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:46.588163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Thu Sep 22 18:10:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:10:53.418330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb783de-4d6d-4786-9e48-28d95d23c38f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:53.418959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb783de-4d6d-4786-9e48-28d95d23c38f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:53.418959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb783de-4d6d-4786-9e48-28d95d23c38f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:53.423774 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:10:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:10:53.429089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:53.429645 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:53.429745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:53.501604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: INFO dbcounter [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] Registered counter for database keystone Sep 22 18:10:53.520406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG oslo_db.sqlalchemy.engines [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 18:10:53.526631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writer thread running {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 18:10:53.709457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG passlib.handlers.bcrypt [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81343) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 18:10:53.709858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG passlib.handlers.bcrypt [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81343) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 18:10:53.767772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:10:53.769415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:10:53.897185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:10:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 22 18:10:54.356494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb783de-4d6d-4786-9e48-28d95d23c38f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:10:54.427303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: INFO dbcounter [None req-bdb783de-4d6d-4786-9e48-28d95d23c38f None None] Registered counter for database keystone Sep 22 18:10:54.449262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG oslo_db.sqlalchemy.engines [None req-bdb783de-4d6d-4786-9e48-28d95d23c38f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 18:10:54.455433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writer thread running {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 18:10:54.575053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb783de-4d6d-4786-9e48-28d95d23c38f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:10:54.579410 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdc364-5266-40b5-b6af-08d5beb20318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:10:54.580042 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc364-5266-40b5-b6af-08d5beb20318 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:54.580329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc364-5266-40b5-b6af-08d5beb20318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:54.580606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc364-5266-40b5-b6af-08d5beb20318 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:54.589141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdc364-5266-40b5-b6af-08d5beb20318 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:10:54.640919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5ebdc364-5266-40b5-b6af-08d5beb20318 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 18:10:54.641266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdc364-5266-40b5-b6af-08d5beb20318 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:10:54.655309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Thu Sep 22 18:10:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:10:54.662008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:10:54.679619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861e2c3-c4a7-4587-b7ab-d0316153cb92 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:10:54.684201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57878ef-d74c-4e68-8d02-8a14b1131fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:10:54.685373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57878ef-d74c-4e68-8d02-8a14b1131fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:54.685663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57878ef-d74c-4e68-8d02-8a14b1131fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:54.685941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57878ef-d74c-4e68-8d02-8a14b1131fc1 admin admin] PATH_INFO: `/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:54.687575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57878ef-d74c-4e68-8d02-8a14b1131fc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=a9e60ccd9c384aa09ff28b8a6b6df44b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:10:54.740588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e57878ef-d74c-4e68-8d02-8a14b1131fc1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 18:10:54.740935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57878ef-d74c-4e68-8d02-8a14b1131fc1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:10:54.745613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Thu Sep 22 18:10:54 2022] GET /identity/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:10:56.876174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a3583-39d3-43d8-a741-5de3c923d928 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:56.876689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a3583-39d3-43d8-a741-5de3c923d928 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:56.876792 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a3583-39d3-43d8-a741-5de3c923d928 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:56.880812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:10:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:10:56.886452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23489c5-ed8a-47bb-898c-cd697b214207 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:56.886868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23489c5-ed8a-47bb-898c-cd697b214207 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:56.887017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23489c5-ed8a-47bb-898c-cd697b214207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:56.906713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a23489c5-ed8a-47bb-898c-cd697b214207 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:10:56.908212 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a23489c5-ed8a-47bb-898c-cd697b214207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:10:56.915973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:10:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 22 18:10:57.189385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a3583-39d3-43d8-a741-5de3c923d928 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:10:57.201712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a3583-39d3-43d8-a741-5de3c923d928 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:10:57.205909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b0dd2-9262-4338-b906-8876f2fd8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:10:57.206512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b0dd2-9262-4338-b906-8876f2fd8e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:57.206790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b0dd2-9262-4338-b906-8876f2fd8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:57.207060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b0dd2-9262-4338-b906-8876f2fd8e2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:57.214910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b0dd2-9262-4338-b906-8876f2fd8e2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:10:57.216667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b0dd2-9262-4338-b906-8876f2fd8e2b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:10:57.225872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Thu Sep 22 18:10:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:10:57.231408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23489c5-ed8a-47bb-898c-cd697b214207 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:10:57.241252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23489c5-ed8a-47bb-898c-cd697b214207 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:10:57.245674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827a03f-0cda-4692-a134-b76ab8fe3a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:10:57.246311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827a03f-0cda-4692-a134-b76ab8fe3a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:57.246601 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827a03f-0cda-4692-a134-b76ab8fe3a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:57.246882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827a03f-0cda-4692-a134-b76ab8fe3a92 admin admin] PATH_INFO: `/v3/users/049d44343a884314a11942aecf5771ab` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:57.248221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827a03f-0cda-4692-a134-b76ab8fe3a92 admin admin] RBAC: Authorizing `identity:get_user(user_id=049d44343a884314a11942aecf5771ab)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:10:57.250138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827a03f-0cda-4692-a134-b76ab8fe3a92 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:10:57.251837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Thu Sep 22 18:10:57 2022] GET /identity/v3/users/049d44343a884314a11942aecf5771ab => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:10:59.489568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceeffd-52be-40a0-898e-a31e7f5508b4 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:59.490116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceeffd-52be-40a0-898e-a31e7f5508b4 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:59.490116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceeffd-52be-40a0-898e-a31e7f5508b4 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:59.491448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:10:59.496720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0febae-df9b-4f2f-a305-d852a927ce2d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:59.497097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0febae-df9b-4f2f-a305-d852a927ce2d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:59.497296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0febae-df9b-4f2f-a305-d852a927ce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:59.516308 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2e0febae-df9b-4f2f-a305-d852a927ce2d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:10:59.517519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2e0febae-df9b-4f2f-a305-d852a927ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:10:59.541960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390ad6-b10b-43bc-8c20-2a11489f068e None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:59.542252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390ad6-b10b-43bc-8c20-2a11489f068e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:59.542536 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390ad6-b10b-43bc-8c20-2a11489f068e None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:59.543862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:10:59.549727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50168cc3-4338-4860-b376-f6989c94d250 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:10:59.550017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50168cc3-4338-4860-b376-f6989c94d250 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:10:59.550299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50168cc3-4338-4860-b376-f6989c94d250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:10:59.593832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG passlib.handlers.bcrypt [None req-50168cc3-4338-4860-b376-f6989c94d250 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81342) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 18:10:59.594311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG passlib.handlers.bcrypt [None req-50168cc3-4338-4860-b376-f6989c94d250 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81342) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 18:10:59.604495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:10:59.643561 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-50168cc3-4338-4860-b376-f6989c94d250 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:10:59.645203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-50168cc3-4338-4860-b376-f6989c94d250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:10:59.750903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:10:59.874697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0febae-df9b-4f2f-a305-d852a927ce2d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:10:59.899584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:10:59.982933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0febae-df9b-4f2f-a305-d852a927ce2d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:00.016304 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deda69-9a1a-404a-8fed-63099a4c3d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:00.016867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deda69-9a1a-404a-8fed-63099a4c3d78 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:00.017151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deda69-9a1a-404a-8fed-63099a4c3d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:00.017456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deda69-9a1a-404a-8fed-63099a4c3d78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:00.021698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50168cc3-4338-4860-b376-f6989c94d250 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:00.028918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06deda69-9a1a-404a-8fed-63099a4c3d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-06deda69-9a1a-404a-8fed-63099a4c3d78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:00.038409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:00.039388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:00.040370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:10:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:00.045220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deda69-9a1a-404a-8fed-63099a4c3d78 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:00.124236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50168cc3-4338-4860-b376-f6989c94d250 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:00.126465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:00.126616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:00.145554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deda69-9a1a-404a-8fed-63099a4c3d78 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:00.162564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d78f-54c2-421f-9f9a-13bfcf2dae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:00.163439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d78f-54c2-421f-9f9a-13bfcf2dae41 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:00.163752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d78f-54c2-421f-9f9a-13bfcf2dae41 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:00.164033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d78f-54c2-421f-9f9a-13bfcf2dae41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:00.180654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c57c6-ab8c-4571-9c8e-a6c2ee019009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:00.181292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c57c6-ab8c-4571-9c8e-a6c2ee019009 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:00.181580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c57c6-ab8c-4571-9c8e-a6c2ee019009 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:00.181859 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c57c6-ab8c-4571-9c8e-a6c2ee019009 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:00.182536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c57c6-ab8c-4571-9c8e-a6c2ee019009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:00.182845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c57c6-ab8c-4571-9c8e-a6c2ee019009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:00.184244 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c57c6-ab8c-4571-9c8e-a6c2ee019009 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:00.196526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:00.202854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c57c6-ab8c-4571-9c8e-a6c2ee019009 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:00.233367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d78f-54c2-421f-9f9a-13bfcf2dae41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:00.235267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d78f-54c2-421f-9f9a-13bfcf2dae41 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:00.307634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c57c6-ab8c-4571-9c8e-a6c2ee019009 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:00.342135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 18:11:00.344063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbd363-a165-42d2-b3b2-4a61ab4f91ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:00.344764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbd363-a165-42d2-b3b2-4a61ab4f91ab None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:00.345126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbd363-a165-42d2-b3b2-4a61ab4f91ab None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:00.345441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbd363-a165-42d2-b3b2-4a61ab4f91ab None admin] PATH_INFO: `/v3/users/049d44343a884314a11942aecf5771ab` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:00.346721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbd363-a165-42d2-b3b2-4a61ab4f91ab None admin] RBAC: Authorizing `identity:get_user(user_id=049d44343a884314a11942aecf5771ab)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:00.347841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d78f-54c2-421f-9f9a-13bfcf2dae41 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:00.348189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbd363-a165-42d2-b3b2-4a61ab4f91ab None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:00.350095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:00 2022] GET /identity/v3/users/049d44343a884314a11942aecf5771ab => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:00.351758 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:00.355411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbd363-a165-42d2-b3b2-4a61ab4f91ab None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:00.369857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:00.453948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d78f-54c2-421f-9f9a-13bfcf2dae41 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:00.470852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbd363-a165-42d2-b3b2-4a61ab4f91ab None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:00.488740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acecd2-7967-44ab-ab94-ee17dfa3ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:00.489872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acecd2-7967-44ab-ab94-ee17dfa3ef10 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:00.490529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acecd2-7967-44ab-ab94-ee17dfa3ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:00.490529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acecd2-7967-44ab-ab94-ee17dfa3ef10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:00.506966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab37d-3b5a-4efe-a147-0ffb7a28ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:00.507618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab37d-3b5a-4efe-a147-0ffb7a28ac2f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:00.507901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab37d-3b5a-4efe-a147-0ffb7a28ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:00.508180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab37d-3b5a-4efe-a147-0ffb7a28ac2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:00.509378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cab37d-3b5a-4efe-a147-0ffb7a28ac2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:00.510079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acecd2-7967-44ab-ab94-ee17dfa3ef10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:00.510848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cab37d-3b5a-4efe-a147-0ffb7a28ac2f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:00.511562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acecd2-7967-44ab-ab94-ee17dfa3ef10 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:00.512441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 10/18] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:00.518662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab37d-3b5a-4efe-a147-0ffb7a28ac2f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-78acecd2-7967-44ab-ab94-ee17dfa3ef10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:11:00.530984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:00.532041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:11:00.533015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:11:00.533015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:11:00.533015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:00.533015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 9/19] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:00.537929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acecd2-7967-44ab-ab94-ee17dfa3ef10 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:00.599233 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:00.604500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:00.624518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab37d-3b5a-4efe-a147-0ffb7a28ac2f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:00.645475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acecd2-7967-44ab-ab94-ee17dfa3ef10 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:00.659528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883c440-3be7-48f2-a16d-b57cfe2cac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:00.660825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883c440-3be7-48f2-a16d-b57cfe2cac35 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:00.661408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883c440-3be7-48f2-a16d-b57cfe2cac35 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:00.661882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883c440-3be7-48f2-a16d-b57cfe2cac35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:00.662628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883c440-3be7-48f2-a16d-b57cfe2cac35 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.domain.id=default, user.id=049d44343a884314a11942aecf5771ab) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:00.662937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883c440-3be7-48f2-a16d-b57cfe2cac35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:00.664372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883c440-3be7-48f2-a16d-b57cfe2cac35 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:00.672458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Thu Sep 22 18:11:00 2022] GET /identity/v3/role_assignments?user.id=049d44343a884314a11942aecf5771ab&scope.domain.id=default&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:00.680944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128e574-eafb-4f7e-90eb-b51601f27ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:00.681626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128e574-eafb-4f7e-90eb-b51601f27ecf None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:00.681916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128e574-eafb-4f7e-90eb-b51601f27ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:00.682196 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128e574-eafb-4f7e-90eb-b51601f27ecf None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:00.682869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128e574-eafb-4f7e-90eb-b51601f27ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:00.683179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128e574-eafb-4f7e-90eb-b51601f27ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:00.684632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128e574-eafb-4f7e-90eb-b51601f27ecf None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:00.706362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:03.015889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94af1c-3a02-493a-a9e8-f8e11d36a2b4 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:03.016380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94af1c-3a02-493a-a9e8-f8e11d36a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:03.016380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94af1c-3a02-493a-a9e8-f8e11d36a2b4 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:03.018038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:03.023512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a1930-fda9-4e22-a430-d0804dd35e7d None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:03.023943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a1930-fda9-4e22-a430-d0804dd35e7d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:03.024125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a1930-fda9-4e22-a430-d0804dd35e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:03.054322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b97a1930-fda9-4e22-a430-d0804dd35e7d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:03.055550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b97a1930-fda9-4e22-a430-d0804dd35e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:03.151154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 11/23] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:03.545443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d14d-5acf-454f-a192-ec7c476c5075 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:03.545796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d14d-5acf-454f-a192-ec7c476c5075 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:03.546095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47d14d-5acf-454f-a192-ec7c476c5075 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:03.547869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:03.553586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1f09-f01e-4722-b4d1-00f2a930f0d1 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:03.553878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1f09-f01e-4722-b4d1-00f2a930f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:03.554165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1f09-f01e-4722-b4d1-00f2a930f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:03.578579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6d4f1f09-f01e-4722-b4d1-00f2a930f0d1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:03.579821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6d4f1f09-f01e-4722-b4d1-00f2a930f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:03.640704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:03.680197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 12/25] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:03.691523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a605b5-c0f5-4e47-b3c7-ed3d3c5ffb1a None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:03.691813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a605b5-c0f5-4e47-b3c7-ed3d3c5ffb1a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:03.692095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a605b5-c0f5-4e47-b3c7-ed3d3c5ffb1a None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:03.693531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f1f09-f01e-4722-b4d1-00f2a930f0d1 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:03.693868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 14/26] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:03.699185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109bbbe-0889-4989-ac07-6a3e251ecb6d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:03.699473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109bbbe-0889-4989-ac07-6a3e251ecb6d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:03.699750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109bbbe-0889-4989-ac07-6a3e251ecb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:03.735069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4109bbbe-0889-4989-ac07-6a3e251ecb6d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:03.736306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4109bbbe-0889-4989-ac07-6a3e251ecb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:03.827088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f1f09-f01e-4722-b4d1-00f2a930f0d1 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:03.874642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 15/27] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:03.878329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec590ce-5896-476e-ae90-863f8f45329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:03.879229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec590ce-5896-476e-ae90-863f8f45329a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:03.879740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec590ce-5896-476e-ae90-863f8f45329a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:03.880213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec590ce-5896-476e-ae90-863f8f45329a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:03.900328 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec590ce-5896-476e-ae90-863f8f45329a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-1ec590ce-5896-476e-ae90-863f8f45329a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:03.907463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:03.908285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:03.909028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:03.911337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 13/28] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:11:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:03.922498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109bbbe-0889-4989-ac07-6a3e251ecb6d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:04.031396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:04.065693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109bbbe-0889-4989-ac07-6a3e251ecb6d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:04.111543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff814eb-3971-49d0-bf66-33d6417e2d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:04.112083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff814eb-3971-49d0-bf66-33d6417e2d56 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:04.112362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff814eb-3971-49d0-bf66-33d6417e2d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:04.112637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff814eb-3971-49d0-bf66-33d6417e2d56 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:04.113330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff814eb-3971-49d0-bf66-33d6417e2d56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:04.113636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff814eb-3971-49d0-bf66-33d6417e2d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:04.115018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff814eb-3971-49d0-bf66-33d6417e2d56 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:04.130093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 16/29] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:04.134274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec590ce-5896-476e-ae90-863f8f45329a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:04.135553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff814eb-3971-49d0-bf66-33d6417e2d56 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:04.210915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:04.311070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec590ce-5896-476e-ae90-863f8f45329a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:04.349363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a98bc3-8021-4b9e-bc1a-08edc524ce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:04.350296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a98bc3-8021-4b9e-bc1a-08edc524ce62 None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:04.350589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a98bc3-8021-4b9e-bc1a-08edc524ce62 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:04.350874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a98bc3-8021-4b9e-bc1a-08edc524ce62 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:04.351859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a98bc3-8021-4b9e-bc1a-08edc524ce62 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:04.354300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a98bc3-8021-4b9e-bc1a-08edc524ce62 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:04.362398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff814eb-3971-49d0-bf66-33d6417e2d56 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:04.414956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b9a33-4369-4cc9-9978-5afd2a2831b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:04.415607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b9a33-4369-4cc9-9978-5afd2a2831b4 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:04.415897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b9a33-4369-4cc9-9978-5afd2a2831b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:04.416177 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b9a33-4369-4cc9-9978-5afd2a2831b4 None admin] PATH_INFO: `/v3/users/049d44343a884314a11942aecf5771ab` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:04.417447 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b9a33-4369-4cc9-9978-5afd2a2831b4 None admin] RBAC: Authorizing `identity:get_user(user_id=049d44343a884314a11942aecf5771ab)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:04.418928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b9a33-4369-4cc9-9978-5afd2a2831b4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:04.420866 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 17/30] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:04 2022] GET /identity/v3/users/049d44343a884314a11942aecf5771ab => generated 247 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:04.422020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b9a33-4369-4cc9-9978-5afd2a2831b4 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:04.426917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:04.527730 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 14/31] 10.222.0.61 () {60 vars in 1131 bytes} [Thu Sep 22 18:11:04 2022] POST /identity/v3/roles => generated 219 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:04.529444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd267-7130-4891-985f-265c485a0c7f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:04.529744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd267-7130-4891-985f-265c485a0c7f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:04.530355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd267-7130-4891-985f-265c485a0c7f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:04.533157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 15/32] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:04.534050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd267-7130-4891-985f-265c485a0c7f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:04.543561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b9a33-4369-4cc9-9978-5afd2a2831b4 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:04.589799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd951f-1b02-4ef0-b38d-980cdafac812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:04.590549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd951f-1b02-4ef0-b38d-980cdafac812 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:04.590832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd951f-1b02-4ef0-b38d-980cdafac812 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:04.591141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd951f-1b02-4ef0-b38d-980cdafac812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:04.630650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd951f-1b02-4ef0-b38d-980cdafac812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:04.632181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd951f-1b02-4ef0-b38d-980cdafac812 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-a2cd951f-1b02-4ef0-b38d-980cdafac812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:11:04.677273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:04.678127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:11:04.678934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:11:04.678934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:11:04.678934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:04.680071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:04.686248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 18/33] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:04.688446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e11c5-2591-47b3-8a63-ac787367271f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:04.688735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e11c5-2591-47b3-8a63-ac787367271f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:04.689014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e11c5-2591-47b3-8a63-ac787367271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:04.693876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd267-7130-4891-985f-265c485a0c7f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:04.736307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d19c0-549d-401a-b0ca-1e0c518237e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:04.737312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d19c0-549d-401a-b0ca-1e0c518237e1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:04.737748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d19c0-549d-401a-b0ca-1e0c518237e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:04.738170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d19c0-549d-401a-b0ca-1e0c518237e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:04.739927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d19c0-549d-401a-b0ca-1e0c518237e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:04.741798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d19c0-549d-401a-b0ca-1e0c518237e1 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:04.743694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 16/34] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:04.744697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d19c0-549d-401a-b0ca-1e0c518237e1 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:04.745178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-655e11c5-2591-47b3-8a63-ac787367271f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:04.746582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-655e11c5-2591-47b3-8a63-ac787367271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:04.828632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:04.856410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 19/35] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:04.857938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e11c5-2591-47b3-8a63-ac787367271f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:04.932208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d19c0-549d-401a-b0ca-1e0c518237e1 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:04.985457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2e8d2-ccb3-4aba-a875-a0bd5c88b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:04.986123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e8d2-ccb3-4aba-a875-a0bd5c88b3ee None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:04.986417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e8d2-ccb3-4aba-a875-a0bd5c88b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:04.986701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e8d2-ccb3-4aba-a875-a0bd5c88b3ee None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:04.987365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2e8d2-ccb3-4aba-a875-a0bd5c88b3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:04.987685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2e8d2-ccb3-4aba-a875-a0bd5c88b3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:04.989132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2e8d2-ccb3-4aba-a875-a0bd5c88b3ee None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:05.008999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 17/36] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:05.010317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb50573-2e92-4cf6-8a94-ea62387895a8 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:05.010611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb50573-2e92-4cf6-8a94-ea62387895a8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:05.010893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb50573-2e92-4cf6-8a94-ea62387895a8 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:05.012120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 18/37] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:05.017710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb50573-2e92-4cf6-8a94-ea62387895a8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:05.028577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e11c5-2591-47b3-8a63-ac787367271f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:05.052468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:05.077406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ba4f5-c22f-4e84-a889-5cb5584db813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:05.078381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ba4f5-c22f-4e84-a889-5cb5584db813 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:05.078654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ba4f5-c22f-4e84-a889-5cb5584db813 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:05.078936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ba4f5-c22f-4e84-a889-5cb5584db813 None admin] PATH_INFO: `/v3/domains/default/users/049d44343a884314a11942aecf5771ab/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:05.081462 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ba4f5-c22f-4e84-a889-5cb5584db813 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=049d44343a884314a11942aecf5771ab, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:05.083195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ba4f5-c22f-4e84-a889-5cb5584db813 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:05.140267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb50573-2e92-4cf6-8a94-ea62387895a8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:05.177052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b98fa7-64e5-460e-b75f-97860e9fce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:05.177705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b98fa7-64e5-460e-b75f-97860e9fce3c None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:05.177994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b98fa7-64e5-460e-b75f-97860e9fce3c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:05.178276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b98fa7-64e5-460e-b75f-97860e9fce3c None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:05.178927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b98fa7-64e5-460e-b75f-97860e9fce3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:05.180377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b98fa7-64e5-460e-b75f-97860e9fce3c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:05.197745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 20/38] 10.222.0.61 () {58 vars in 1361 bytes} [Thu Sep 22 18:11:04 2022] PUT /identity/v3/domains/default/users/049d44343a884314a11942aecf5771ab/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:11:05.199460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f166e1-b606-4e76-b885-cdcc9d45647d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:05.199835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f166e1-b606-4e76-b885-cdcc9d45647d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:05.199981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f166e1-b606-4e76-b885-cdcc9d45647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:05.221222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:11:05 2022] POST /identity/v3/projects => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:05.222609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b866d4c-8ad5-4923-97f7-96c5da1d900f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:05.222962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b866d4c-8ad5-4923-97f7-96c5da1d900f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:05.223246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b866d4c-8ad5-4923-97f7-96c5da1d900f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:05.224869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 20/40] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:05.226188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b866d4c-8ad5-4923-97f7-96c5da1d900f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:05.235399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-09f166e1-b606-4e76-b885-cdcc9d45647d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:05.237539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-09f166e1-b606-4e76-b885-cdcc9d45647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:05.333810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:05.361668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:05.366096 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 21/41] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:05.368032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342770e-68f0-45d9-89d0-22dc800af5dd None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:05.368229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342770e-68f0-45d9-89d0-22dc800af5dd None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:05.368501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342770e-68f0-45d9-89d0-22dc800af5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:05.385072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b866d4c-8ad5-4923-97f7-96c5da1d900f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:05.389220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6342770e-68f0-45d9-89d0-22dc800af5dd None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:05.391207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6342770e-68f0-45d9-89d0-22dc800af5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:05.436181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbf566-0245-4bcd-bd96-bbc1ec4308ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:05.436594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbf566-0245-4bcd-bd96-bbc1ec4308ce None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:05.436899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbf566-0245-4bcd-bd96-bbc1ec4308ce None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:05.437176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbf566-0245-4bcd-bd96-bbc1ec4308ce None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:05.437948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbf566-0245-4bcd-bd96-bbc1ec4308ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:05.439275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbf566-0245-4bcd-bd96-bbc1ec4308ce None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:05.458344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 21/42] 10.222.0.61 () {60 vars in 1131 bytes} [Thu Sep 22 18:11:05 2022] POST /identity/v3/roles => generated 225 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:05.487458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 22/43] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:05.685478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbf566-0245-4bcd-bd96-bbc1ec4308ce None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:05.764620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342770e-68f0-45d9-89d0-22dc800af5dd None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:05.812901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbf566-0245-4bcd-bd96-bbc1ec4308ce None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:05.872811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342770e-68f0-45d9-89d0-22dc800af5dd None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:05.879380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df84215-ffca-4cb7-aa77-73926f4fba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:05.880319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84215-ffca-4cb7-aa77-73926f4fba11 None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:05.880735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84215-ffca-4cb7-aa77-73926f4fba11 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:05.881168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84215-ffca-4cb7-aa77-73926f4fba11 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:05.882165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df84215-ffca-4cb7-aa77-73926f4fba11 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:05.884184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df84215-ffca-4cb7-aa77-73926f4fba11 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:05.890522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:05.907952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 22/44] 10.222.0.61 () {60 vars in 1131 bytes} [Thu Sep 22 18:11:05 2022] POST /identity/v3/roles => generated 223 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:05.990681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:06.044056 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c76a43-35a5-4f06-a4da-f15bdb53465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:06.045657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76a43-35a5-4f06-a4da-f15bdb53465c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:06.047441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76a43-35a5-4f06-a4da-f15bdb53465c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:06.048220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76a43-35a5-4f06-a4da-f15bdb53465c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:06.050768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c76a43-35a5-4f06-a4da-f15bdb53465c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:06.054930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c76a43-35a5-4f06-a4da-f15bdb53465c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:06.066289 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 23/45] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:06.072484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df84215-ffca-4cb7-aa77-73926f4fba11 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:06.214236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df84215-ffca-4cb7-aa77-73926f4fba11 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:06.250842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8382517-e884-44c6-8907-014057c085c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:06.251496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8382517-e884-44c6-8907-014057c085c0 None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:06.251809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8382517-e884-44c6-8907-014057c085c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:06.252063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8382517-e884-44c6-8907-014057c085c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:06.252717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8382517-e884-44c6-8907-014057c085c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:06.254200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8382517-e884-44c6-8907-014057c085c0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:06.281813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 23/46] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:11:06 2022] POST /identity/v3/projects => generated 312 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:07.656021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da94c47-f80b-4094-8281-81f32d2ad9d1 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:07.656570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da94c47-f80b-4094-8281-81f32d2ad9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:07.656570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da94c47-f80b-4094-8281-81f32d2ad9d1 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:07.658156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 24/47] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:07.663298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e851f08-e124-4f25-97b1-5223c42f94f5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:07.663718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e851f08-e124-4f25-97b1-5223c42f94f5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:07.663880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e851f08-e124-4f25-97b1-5223c42f94f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:07.682155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6e851f08-e124-4f25-97b1-5223c42f94f5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:07.683665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6e851f08-e124-4f25-97b1-5223c42f94f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:07.727651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:07.758762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 24/48] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:08.026329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da94c47-f80b-4094-8281-81f32d2ad9d1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:08.129800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da94c47-f80b-4094-8281-81f32d2ad9d1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:08.163678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31aeb8-7b91-47b7-8178-701866447043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:08.164325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31aeb8-7b91-47b7-8178-701866447043 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:08.164613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31aeb8-7b91-47b7-8178-701866447043 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:08.164894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31aeb8-7b91-47b7-8178-701866447043 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:08.175476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31aeb8-7b91-47b7-8178-701866447043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ab31aeb8-7b91-47b7-8178-701866447043 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:08.180403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:08.181253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:08.182010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 25/49] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:08.188109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e851f08-e124-4f25-97b1-5223c42f94f5 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:08.285798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e851f08-e124-4f25-97b1-5223c42f94f5 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:08.320970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7fa1b-9582-4f28-a4d0-e7e399459bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:08.321623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7fa1b-9582-4f28-a4d0-e7e399459bcb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:08.321914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7fa1b-9582-4f28-a4d0-e7e399459bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:08.322201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7fa1b-9582-4f28-a4d0-e7e399459bcb None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:08.322872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7fa1b-9582-4f28-a4d0-e7e399459bcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:08.323182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7fa1b-9582-4f28-a4d0-e7e399459bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:08.324565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7fa1b-9582-4f28-a4d0-e7e399459bcb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:08.337750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 25/50] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:08.344300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31aeb8-7b91-47b7-8178-701866447043 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:08.381378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:08.451043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31aeb8-7b91-47b7-8178-701866447043 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:08.460832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f46b4-28d6-4083-bb0f-8c3cc3779711 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:08.461136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f46b4-28d6-4083-bb0f-8c3cc3779711 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:08.461496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f46b4-28d6-4083-bb0f-8c3cc3779711 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:08.462825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 26/51] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:08.467709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c895e7-3549-4121-b239-9296cebd7fd4 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:08.468581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c895e7-3549-4121-b239-9296cebd7fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:08.468930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c895e7-3549-4121-b239-9296cebd7fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:08.488433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f107128-c8c8-4cd0-87bd-17fd99d19b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:08.489101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f107128-c8c8-4cd0-87bd-17fd99d19b07 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:08.489430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f107128-c8c8-4cd0-87bd-17fd99d19b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:08.489713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f107128-c8c8-4cd0-87bd-17fd99d19b07 None admin] PATH_INFO: `/v3/users/049d44343a884314a11942aecf5771ab` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:08.490927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f107128-c8c8-4cd0-87bd-17fd99d19b07 None admin] RBAC: Authorizing `identity:get_user(user_id=049d44343a884314a11942aecf5771ab)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:08.492450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f107128-c8c8-4cd0-87bd-17fd99d19b07 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:08.494189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 26/52] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:08 2022] GET /identity/v3/users/049d44343a884314a11942aecf5771ab => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:08.500563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f107128-c8c8-4cd0-87bd-17fd99d19b07 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:08.590620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b0c895e7-3549-4121-b239-9296cebd7fd4 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:08.591767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b0c895e7-3549-4121-b239-9296cebd7fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:08.609049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f107128-c8c8-4cd0-87bd-17fd99d19b07 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:08.610625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:08.627202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:08.644798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b3865-6d82-4723-8005-15a4d388b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:08.645475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b3865-6d82-4723-8005-15a4d388b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:08.645764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b3865-6d82-4723-8005-15a4d388b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:08.646041 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b3865-6d82-4723-8005-15a4d388b6b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:08.647184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b3865-6d82-4723-8005-15a4d388b6b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:08.648656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b3865-6d82-4723-8005-15a4d388b6b9 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:08.650267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 27/53] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:08.656034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b3865-6d82-4723-8005-15a4d388b6b9 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:08.663989 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 27/54] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:08.762981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b3865-6d82-4723-8005-15a4d388b6b9 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:08.798324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2fa4-681c-42ba-aaaa-9e795334c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:08.798937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2fa4-681c-42ba-aaaa-9e795334c925 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:08.799287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2fa4-681c-42ba-aaaa-9e795334c925 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:08.799499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2fa4-681c-42ba-aaaa-9e795334c925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:08.800227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae2fa4-681c-42ba-aaaa-9e795334c925 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.domain.id=default, user.id=049d44343a884314a11942aecf5771ab) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:08.800535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae2fa4-681c-42ba-aaaa-9e795334c925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:08.802019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae2fa4-681c-42ba-aaaa-9e795334c925 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:08.807907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 28/55] 10.222.0.61 () {56 vars in 1322 bytes} [Thu Sep 22 18:11:08 2022] GET /identity/v3/role_assignments?user.id=049d44343a884314a11942aecf5771ab&scope.domain.id=default&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:08.935884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c895e7-3549-4121-b239-9296cebd7fd4 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:09.041463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c895e7-3549-4121-b239-9296cebd7fd4 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:09.074059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58ea3e-7852-4f3d-8d48-ebcd91c7a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:09.074700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58ea3e-7852-4f3d-8d48-ebcd91c7a57d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:09.074982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58ea3e-7852-4f3d-8d48-ebcd91c7a57d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:09.075254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58ea3e-7852-4f3d-8d48-ebcd91c7a57d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:09.076343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58ea3e-7852-4f3d-8d48-ebcd91c7a57d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:09.078480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58ea3e-7852-4f3d-8d48-ebcd91c7a57d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:09.080037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 28/56] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:09.086557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2fa4-681c-42ba-aaaa-9e795334c925 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:09.122173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:09.189731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2fa4-681c-42ba-aaaa-9e795334c925 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:09.224625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a14b75-ec96-42ac-b948-0e10302ce173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:09.225273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a14b75-ec96-42ac-b948-0e10302ce173 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:09.225561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a14b75-ec96-42ac-b948-0e10302ce173 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:09.225841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a14b75-ec96-42ac-b948-0e10302ce173 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:09.226506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a14b75-ec96-42ac-b948-0e10302ce173 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:09.227962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a14b75-ec96-42ac-b948-0e10302ce173 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:09.257650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 29/57] 10.222.0.61 () {60 vars in 1140 bytes} [Thu Sep 22 18:11:09 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:11:11.411177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58751156-d0e1-42a5-8302-775bf8d41d37 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:11.411690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58751156-d0e1-42a5-8302-775bf8d41d37 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:11.411776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58751156-d0e1-42a5-8302-775bf8d41d37 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:11.413071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 29/58] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:11.418309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbbbde-8b0f-45f2-bdd3-7119c5a73798 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:11.418950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbbbde-8b0f-45f2-bdd3-7119c5a73798 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:11.418950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbbbde-8b0f-45f2-bdd3-7119c5a73798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:11.437841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e7dbbbde-8b0f-45f2-bdd3-7119c5a73798 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:11.439086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e7dbbbde-8b0f-45f2-bdd3-7119c5a73798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:11.506964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 30/59] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:11.776217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58751156-d0e1-42a5-8302-775bf8d41d37 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:11.817807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:11.880982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58751156-d0e1-42a5-8302-775bf8d41d37 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:11.916155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2180890-5973-438c-825d-1df678291c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:11.916794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2180890-5973-438c-825d-1df678291c67 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:11.917078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2180890-5973-438c-825d-1df678291c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:11.917391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2180890-5973-438c-825d-1df678291c67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:11.918520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2180890-5973-438c-825d-1df678291c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:11.919958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2180890-5973-438c-825d-1df678291c67 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:11.922078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 30/60] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:11.927844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbbbde-8b0f-45f2-bdd3-7119c5a73798 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:11.945229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:12.026037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbbbde-8b0f-45f2-bdd3-7119c5a73798 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:12.058864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918ef2a-7197-4906-8fe0-dd2920e8333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:12.059473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918ef2a-7197-4906-8fe0-dd2920e8333d None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:12.059756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918ef2a-7197-4906-8fe0-dd2920e8333d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:12.060031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918ef2a-7197-4906-8fe0-dd2920e8333d None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:12.060673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918ef2a-7197-4906-8fe0-dd2920e8333d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:12.062174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918ef2a-7197-4906-8fe0-dd2920e8333d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:12.088265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 31/61] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:11:11 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:15.351387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08bc6-3091-4c8b-968d-5f01949c86b7 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:15.352403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08bc6-3091-4c8b-968d-5f01949c86b7 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:15.352916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08bc6-3091-4c8b-968d-5f01949c86b7 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:15.354540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 31/62] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:15.360943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789f0af-6555-47b0-8606-1682817f8b2c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:15.361836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789f0af-6555-47b0-8606-1682817f8b2c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:15.362326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789f0af-6555-47b0-8606-1682817f8b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:15.381045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-0789f0af-6555-47b0-8606-1682817f8b2c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:15.382585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0789f0af-6555-47b0-8606-1682817f8b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:15.445510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bf58a-0152-41fe-a5d5-409b98dba693 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:15.446117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bf58a-0152-41fe-a5d5-409b98dba693 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:15.446589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bf58a-0152-41fe-a5d5-409b98dba693 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:15.448134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 32/63] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:15.453466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e10349-412c-4472-9627-56c32b54f8cb None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:15.454072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e10349-412c-4472-9627-56c32b54f8cb None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:15.454552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e10349-412c-4472-9627-56c32b54f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:15.457805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 32/64] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:15.486311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-12e10349-412c-4472-9627-56c32b54f8cb None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:15.487541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-12e10349-412c-4472-9627-56c32b54f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:15.603851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 33/65] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:15.727145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789f0af-6555-47b0-8606-1682817f8b2c None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:15.729745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:15.842345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789f0af-6555-47b0-8606-1682817f8b2c None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:15.879151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a40d72-c068-46a5-b75e-deffedca1f09 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:15.879449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a40d72-c068-46a5-b75e-deffedca1f09 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:15.879630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a40d72-c068-46a5-b75e-deffedca1f09 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:15.880974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 34/66] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:15.886086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd9549-2d9c-4700-9140-50904f2a5704 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:15.886378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd9549-2d9c-4700-9140-50904f2a5704 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:15.886658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd9549-2d9c-4700-9140-50904f2a5704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:15.888837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c4ce2-dd87-422f-adb2-cde6634180e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:15.890150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c4ce2-dd87-422f-adb2-cde6634180e5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:15.890544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c4ce2-dd87-422f-adb2-cde6634180e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:15.890830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c4ce2-dd87-422f-adb2-cde6634180e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:15.903683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c4ce2-dd87-422f-adb2-cde6634180e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-804c4ce2-dd87-422f-adb2-cde6634180e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:15.909037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:15.909907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:15.910673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 33/67] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:15.915945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c4ce2-dd87-422f-adb2-cde6634180e5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:15.924158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-afcd9549-2d9c-4700-9140-50904f2a5704 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:15.925399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-afcd9549-2d9c-4700-9140-50904f2a5704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:15.985772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:15.995409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:16.043781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c4ce2-dd87-422f-adb2-cde6634180e5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:16.069492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 35/68] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:16.070700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd9549-2d9c-4700-9140-50904f2a5704 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:16.089102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45655c40-70ba-4ffb-b33a-b9dd0db6c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:16.089905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45655c40-70ba-4ffb-b33a-b9dd0db6c556 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.090194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45655c40-70ba-4ffb-b33a-b9dd0db6c556 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.090473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45655c40-70ba-4ffb-b33a-b9dd0db6c556 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.091300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45655c40-70ba-4ffb-b33a-b9dd0db6c556 None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:16.091610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45655c40-70ba-4ffb-b33a-b9dd0db6c556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:16.093612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45655c40-70ba-4ffb-b33a-b9dd0db6c556 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:16.104407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:16.109948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45655c40-70ba-4ffb-b33a-b9dd0db6c556 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:16.216420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd9549-2d9c-4700-9140-50904f2a5704 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:16.240052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45655c40-70ba-4ffb-b33a-b9dd0db6c556 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:16.258339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ae7b7-36bd-45b2-8f9c-ee61d3f5a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:16.259034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ae7b7-36bd-45b2-8f9c-ee61d3f5a579 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.259325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ae7b7-36bd-45b2-8f9c-ee61d3f5a579 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.259606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ae7b7-36bd-45b2-8f9c-ee61d3f5a579 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.268546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:16.273647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ae7b7-36bd-45b2-8f9c-ee61d3f5a579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-f96ae7b7-36bd-45b2-8f9c-ee61d3f5a579 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:16.278569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:16.279416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:16.280156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 36/70] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:11:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:16.281949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbab418-66c5-482d-9240-4cb3a46c7633 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.282223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbab418-66c5-482d-9240-4cb3a46c7633 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.282505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbab418-66c5-482d-9240-4cb3a46c7633 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.283960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 37/71] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:16.286953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b372f-7462-4d18-a123-35247d0122d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:16.287597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b372f-7462-4d18-a123-35247d0122d6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.288112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b372f-7462-4d18-a123-35247d0122d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.288397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b372f-7462-4d18-a123-35247d0122d6 None admin] PATH_INFO: `/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.288937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e81f-cee4-409e-8470-1cd6a805eb3f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.289185 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e81f-cee4-409e-8470-1cd6a805eb3f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.289549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e81f-cee4-409e-8470-1cd6a805eb3f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.294236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 38/72] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:16.294236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e81f-cee4-409e-8470-1cd6a805eb3f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:16.307292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b372f-7462-4d18-a123-35247d0122d6 None admin] RBAC: Authorizing `identity:get_user(user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:16.308755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b372f-7462-4d18-a123-35247d0122d6 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:16.314792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 35/73] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:16 2022] GET /identity/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:16.314792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88188d-cc63-4d48-80e1-38631ab81050 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.314792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88188d-cc63-4d48-80e1-38631ab81050 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.314792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88188d-cc63-4d48-80e1-38631ab81050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.328954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:16.329893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6d88188d-cc63-4d48-80e1-38631ab81050 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:16.331076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6d88188d-cc63-4d48-80e1-38631ab81050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:16.404639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 36/74] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:16.406495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee1b0-7c1a-4ad5-97e6-a995b9cda314 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.406886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee1b0-7c1a-4ad5-97e6-a995b9cda314 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.407262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eee1b0-7c1a-4ad5-97e6-a995b9cda314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.416909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e81f-cee4-409e-8470-1cd6a805eb3f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:16.429761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-13eee1b0-7c1a-4ad5-97e6-a995b9cda314 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:16.431023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-13eee1b0-7c1a-4ad5-97e6-a995b9cda314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:16.460998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42778-438f-4c29-93fd-d5ac7b269b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:16.461713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42778-438f-4c29-93fd-d5ac7b269b17 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.462260 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42778-438f-4c29-93fd-d5ac7b269b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.462561 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42778-438f-4c29-93fd-d5ac7b269b17 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.463312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e42778-438f-4c29-93fd-d5ac7b269b17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:16.463629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e42778-438f-4c29-93fd-d5ac7b269b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:16.465068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e42778-438f-4c29-93fd-d5ac7b269b17 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:16.474583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 39/75] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:16.475157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42778-438f-4c29-93fd-d5ac7b269b17 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:16.521971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 37/76] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:16.522854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eee1b0-7c1a-4ad5-97e6-a995b9cda314 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:16.598292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:16.607833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:16.628358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42778-438f-4c29-93fd-d5ac7b269b17 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:16.669522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eee1b0-7c1a-4ad5-97e6-a995b9cda314 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:16.670556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27178a-9fd3-4a2d-80f2-deda8d7d4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:16.671814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27178a-9fd3-4a2d-80f2-deda8d7d4c8f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.672259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27178a-9fd3-4a2d-80f2-deda8d7d4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.674598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27178a-9fd3-4a2d-80f2-deda8d7d4c8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.711880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a980bd0-711f-4f3d-bf42-ca10218c5fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:16.712526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a980bd0-711f-4f3d-bf42-ca10218c5fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.712806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a980bd0-711f-4f3d-bf42-ca10218c5fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.713081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a980bd0-711f-4f3d-bf42-ca10218c5fe2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.724422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a980bd0-711f-4f3d-bf42-ca10218c5fe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-7a980bd0-711f-4f3d-bf42-ca10218c5fe2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:16.729451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:16.730392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:16.731146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 38/77] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:11:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:16.731758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a980bd0-711f-4f3d-bf42-ca10218c5fe2 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:16.754379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27178a-9fd3-4a2d-80f2-deda8d7d4c8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:16.755852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27178a-9fd3-4a2d-80f2-deda8d7d4c8f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:16.846484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a980bd0-711f-4f3d-bf42-ca10218c5fe2 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:16.847021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:16.848052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:16.860751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 40/78] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:16.861615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27178a-9fd3-4a2d-80f2-deda8d7d4c8f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:16.882302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8cb0d-cc1a-4f11-a392-b9c04a98a6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:16.882943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8cb0d-cc1a-4f11-a392-b9c04a98a6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:16.883227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8cb0d-cc1a-4f11-a392-b9c04a98a6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:16.883504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8cb0d-cc1a-4f11-a392-b9c04a98a6f6 None admin] PATH_INFO: `/v3/users/049d44343a884314a11942aecf5771ab` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:16.884665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8cb0d-cc1a-4f11-a392-b9c04a98a6f6 None admin] RBAC: Authorizing `identity:get_user(user_id=049d44343a884314a11942aecf5771ab)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:16.886145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8cb0d-cc1a-4f11-a392-b9c04a98a6f6 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:16.887716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 39/79] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:16 2022] GET /identity/v3/users/049d44343a884314a11942aecf5771ab => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:16.888474 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8cb0d-cc1a-4f11-a392-b9c04a98a6f6 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:16.969945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27178a-9fd3-4a2d-80f2-deda8d7d4c8f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:16.997003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8cb0d-cc1a-4f11-a392-b9c04a98a6f6 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.013118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace28f7f-ac09-4a85-ac34-14d40f2271bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.014091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace28f7f-ac09-4a85-ac34-14d40f2271bf None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.014523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace28f7f-ac09-4a85-ac34-14d40f2271bf None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.014981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace28f7f-ac09-4a85-ac34-14d40f2271bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.028973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace28f7f-ac09-4a85-ac34-14d40f2271bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:17.032064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26709-d0b9-40ee-a8ab-7df10cf47d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.032678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26709-d0b9-40ee-a8ab-7df10cf47d77 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.032964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26709-d0b9-40ee-a8ab-7df10cf47d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.033264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26709-d0b9-40ee-a8ab-7df10cf47d77 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.033951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a26709-d0b9-40ee-a8ab-7df10cf47d77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:17.034251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a26709-d0b9-40ee-a8ab-7df10cf47d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.035627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a26709-d0b9-40ee-a8ab-7df10cf47d77 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-ace28f7f-ac09-4a85-ac34-14d40f2271bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:17.037205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:17.038056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:17.038928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 41/80] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:17.039725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace28f7f-ac09-4a85-ac34-14d40f2271bf None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.048489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 40/81] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:11:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:17.049363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26709-d0b9-40ee-a8ab-7df10cf47d77 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.081263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:17.094102 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:17.145530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace28f7f-ac09-4a85-ac34-14d40f2271bf None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.151577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26709-d0b9-40ee-a8ab-7df10cf47d77 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.179485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c1905-f79c-4e7e-a3da-4d41548d064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.180130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c1905-f79c-4e7e-a3da-4d41548d064f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.180424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c1905-f79c-4e7e-a3da-4d41548d064f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.180707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c1905-f79c-4e7e-a3da-4d41548d064f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.181887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c1905-f79c-4e7e-a3da-4d41548d064f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.183366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c1905-f79c-4e7e-a3da-4d41548d064f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:17.184952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 42/82] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:17.185045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f76390-3a8e-42cc-9005-557e7f0554ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.185686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76390-3a8e-42cc-9005-557e7f0554ee None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.185797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c1905-f79c-4e7e-a3da-4d41548d064f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.185972 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76390-3a8e-42cc-9005-557e7f0554ee None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.186274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76390-3a8e-42cc-9005-557e7f0554ee None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.187940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f76390-3a8e-42cc-9005-557e7f0554ee None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.189408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f76390-3a8e-42cc-9005-557e7f0554ee None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:17.191187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 41/83] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:17 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:17.191810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f76390-3a8e-42cc-9005-557e7f0554ee None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.288295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c1905-f79c-4e7e-a3da-4d41548d064f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.290324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:17.293029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f76390-3a8e-42cc-9005-557e7f0554ee None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.308857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:17.330266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5bb0f-ecdc-4988-bc0e-93405909fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.331130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5bb0f-ecdc-4988-bc0e-93405909fae8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.331414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5bb0f-ecdc-4988-bc0e-93405909fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.331691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5bb0f-ecdc-4988-bc0e-93405909fae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.331792 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c2fb-538b-4967-b656-a127889c22fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.332334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c2fb-538b-4967-b656-a127889c22fe None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.332418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5bb0f-ecdc-4988-bc0e-93405909fae8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:17.332712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c2fb-538b-4967-b656-a127889c22fe None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.332854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5bb0f-ecdc-4988-bc0e-93405909fae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.332940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c2fb-538b-4967-b656-a127889c22fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.334799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5bb0f-ecdc-4988-bc0e-93405909fae8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:17.345883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 42/84] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:17.346860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5bb0f-ecdc-4988-bc0e-93405909fae8 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.405056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c2fb-538b-4967-b656-a127889c22fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.406579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c2fb-538b-4967-b656-a127889c22fe None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:17.451767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5bb0f-ecdc-4988-bc0e-93405909fae8 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.485457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d067ac8-555d-4f35-aa32-d1052429605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.486102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d067ac8-555d-4f35-aa32-d1052429605e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.486389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d067ac8-555d-4f35-aa32-d1052429605e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.486666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d067ac8-555d-4f35-aa32-d1052429605e None admin] PATH_INFO: `/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.487795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d067ac8-555d-4f35-aa32-d1052429605e None admin] RBAC: Authorizing `identity:get_user(user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.489282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d067ac8-555d-4f35-aa32-d1052429605e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:17.490886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 43/85] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:17 2022] GET /identity/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:17.491627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d067ac8-555d-4f35-aa32-d1052429605e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.511280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 43/86] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:17.512633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c2fb-538b-4967-b656-a127889c22fe None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.530941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:17.534781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:17.604519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d067ac8-555d-4f35-aa32-d1052429605e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.613028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c2fb-538b-4967-b656-a127889c22fe None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.638204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6adf0-2b1f-48b0-9803-6280496569ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.638929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6adf0-2b1f-48b0-9803-6280496569ec None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.639221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6adf0-2b1f-48b0-9803-6280496569ec None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.639567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6adf0-2b1f-48b0-9803-6280496569ec None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.640713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6adf0-2b1f-48b0-9803-6280496569ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.642232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6adf0-2b1f-48b0-9803-6280496569ec None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:17.648743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fa684-48a8-4862-a140-4dac9e4c942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.649419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fa684-48a8-4862-a140-4dac9e4c942a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.649711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fa684-48a8-4862-a140-4dac9e4c942a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.649994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fa684-48a8-4862-a140-4dac9e4c942a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.650918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fa684-48a8-4862-a140-4dac9e4c942a None admin] RBAC: Adding query filter params (role.id=7c59786364c04f0087154923c39fa449, scope.project.id=5039b090c00e4b52901878d5da90d9a4, user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:17.651683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fa684-48a8-4862-a140-4dac9e4c942a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.653160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fa684-48a8-4862-a140-4dac9e4c942a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:17.666854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 44/87] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:11:17 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:17.666854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6adf0-2b1f-48b0-9803-6280496569ec None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.689692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 44/88] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:17 2022] GET /identity/v3/role_assignments?user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=7c59786364c04f0087154923c39fa449 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:17.689692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fa684-48a8-4862-a140-4dac9e4c942a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.796902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:17.811061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:17.820787 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6adf0-2b1f-48b0-9803-6280496569ec None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.840876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fa684-48a8-4862-a140-4dac9e4c942a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:17.866226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d7d74-3c08-423d-8f10-b1af597f99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.866809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d7d74-3c08-423d-8f10-b1af597f99bf None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.867094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d7d74-3c08-423d-8f10-b1af597f99bf None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.867370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d7d74-3c08-423d-8f10-b1af597f99bf None admin] PATH_INFO: `/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.868548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d7d74-3c08-423d-8f10-b1af597f99bf None admin] RBAC: Authorizing `identity:get_user(user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.870095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d7d74-3c08-423d-8f10-b1af597f99bf None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:17.871742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 45/89] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:17 2022] GET /identity/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:17.872872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d7d74-3c08-423d-8f10-b1af597f99bf None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:17.883823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54782df-cbc2-4e25-916e-c1471df99bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:17.884448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54782df-cbc2-4e25-916e-c1471df99bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:17.884735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54782df-cbc2-4e25-916e-c1471df99bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:17.885013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54782df-cbc2-4e25-916e-c1471df99bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:17.985028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54782df-cbc2-4e25-916e-c1471df99bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:17.986848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54782df-cbc2-4e25-916e-c1471df99bb3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:18.005183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d7d74-3c08-423d-8f10-b1af597f99bf None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:18.059380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a15e2-7c60-420b-b197-dd25ce2f9980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:18.060148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a15e2-7c60-420b-b197-dd25ce2f9980 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:18.060909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a15e2-7c60-420b-b197-dd25ce2f9980 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:18.061076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a15e2-7c60-420b-b197-dd25ce2f9980 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:18.062565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a15e2-7c60-420b-b197-dd25ce2f9980 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:18.064261 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a15e2-7c60-420b-b197-dd25ce2f9980 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:18.066589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 46/90] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:17 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:18.067589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a15e2-7c60-420b-b197-dd25ce2f9980 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:18.098325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:18.101319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:18.130011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 45/91] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:18.130844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54782df-cbc2-4e25-916e-c1471df99bb3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:18.199782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a15e2-7c60-420b-b197-dd25ce2f9980 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:18.249827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5295-9c75-4d98-8634-7fe52de2710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:18.250638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5295-9c75-4d98-8634-7fe52de2710b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:18.251290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5295-9c75-4d98-8634-7fe52de2710b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:18.251580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5295-9c75-4d98-8634-7fe52de2710b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:18.259614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54782df-cbc2-4e25-916e-c1471df99bb3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:18.302146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75659b04-55f6-463e-99ba-e9c0788091d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:18.302874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75659b04-55f6-463e-99ba-e9c0788091d7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:18.303240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75659b04-55f6-463e-99ba-e9c0788091d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:18.303599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75659b04-55f6-463e-99ba-e9c0788091d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:18.304409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75659b04-55f6-463e-99ba-e9c0788091d7 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=5039b090c00e4b52901878d5da90d9a4, user.id=049d44343a884314a11942aecf5771ab) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:18.304801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75659b04-55f6-463e-99ba-e9c0788091d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:18.306401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75659b04-55f6-463e-99ba-e9c0788091d7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:18.313145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 46/92] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:18 2022] GET /identity/v3/role_assignments?user.id=049d44343a884314a11942aecf5771ab&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:18.314155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75659b04-55f6-463e-99ba-e9c0788091d7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:18.361083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5295-9c75-4d98-8634-7fe52de2710b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:18.362754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5295-9c75-4d98-8634-7fe52de2710b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:18.397079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:18.411936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:18.480096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75659b04-55f6-463e-99ba-e9c0788091d7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:18.558945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c67540-8484-4023-bcc4-41f91be321e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:18.559666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c67540-8484-4023-bcc4-41f91be321e0 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:18.560098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c67540-8484-4023-bcc4-41f91be321e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:18.560456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c67540-8484-4023-bcc4-41f91be321e0 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:18.563338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 47/93] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:18.564267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c67540-8484-4023-bcc4-41f91be321e0 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:18.565862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c67540-8484-4023-bcc4-41f91be321e0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:18.567681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 47/94] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:18 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:18.574228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c67540-8484-4023-bcc4-41f91be321e0 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:18.574514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5295-9c75-4d98-8634-7fe52de2710b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:18.807408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5295-9c75-4d98-8634-7fe52de2710b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:18.814879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c67540-8484-4023-bcc4-41f91be321e0 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:18.839106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:18.855902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:18.877757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52464ff8-8a97-4f92-8420-dd07088a534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:18.878423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52464ff8-8a97-4f92-8420-dd07088a534a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:18.878710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52464ff8-8a97-4f92-8420-dd07088a534a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:18.878991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52464ff8-8a97-4f92-8420-dd07088a534a None admin] PATH_INFO: `/v3/projects/0f2ea7cbd48a4cddb7f8f3290d22678c` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:18.880138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52464ff8-8a97-4f92-8420-dd07088a534a None admin] RBAC: Authorizing `identity:get_project(project_id=0f2ea7cbd48a4cddb7f8f3290d22678c)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:18.881750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52464ff8-8a97-4f92-8420-dd07088a534a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:18.883410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 48/95] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:18 2022] GET /identity/v3/projects/0f2ea7cbd48a4cddb7f8f3290d22678c => generated 312 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:18.890235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52464ff8-8a97-4f92-8420-dd07088a534a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:18.898529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91680545-c18c-4274-a6ac-774c6737154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:18.899169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91680545-c18c-4274-a6ac-774c6737154d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:18.899459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91680545-c18c-4274-a6ac-774c6737154d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:18.899742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91680545-c18c-4274-a6ac-774c6737154d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:18.900500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91680545-c18c-4274-a6ac-774c6737154d None admin] RBAC: Adding query filter params (role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=5039b090c00e4b52901878d5da90d9a4, user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:18.900801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91680545-c18c-4274-a6ac-774c6737154d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:18.902277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91680545-c18c-4274-a6ac-774c6737154d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:18.917748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 48/96] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:18 2022] GET /identity/v3/role_assignments?user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 259 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:19.059370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52464ff8-8a97-4f92-8420-dd07088a534a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:19.118131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ddfe9-d515-4305-a417-52310daef4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:19.118789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ddfe9-d515-4305-a417-52310daef4cc None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:19.119082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ddfe9-d515-4305-a417-52310daef4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:19.119367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ddfe9-d515-4305-a417-52310daef4cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:19.120130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ddfe9-d515-4305-a417-52310daef4cc None admin] RBAC: Adding query filter params (role.id=7c59786364c04f0087154923c39fa449, scope.project.id=0f2ea7cbd48a4cddb7f8f3290d22678c, user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:19.120453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ddfe9-d515-4305-a417-52310daef4cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:19.121969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ddfe9-d515-4305-a417-52310daef4cc None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:19.128758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 49/97] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:18 2022] GET /identity/v3/role_assignments?user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6&scope.project.id=0f2ea7cbd48a4cddb7f8f3290d22678c&role.id=7c59786364c04f0087154923c39fa449 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:20.384851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4013768-1994-486b-ae0d-b6f04b5757a0 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:20.384851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4013768-1994-486b-ae0d-b6f04b5757a0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:20.384851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4013768-1994-486b-ae0d-b6f04b5757a0 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:20.384851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 49/98] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:20.391300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e384-a6e5-4308-8fa2-e3b0836f2cc3 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:20.392119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e384-a6e5-4308-8fa2-e3b0836f2cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:20.392597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e384-a6e5-4308-8fa2-e3b0836f2cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:20.411570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-fc01e384-a6e5-4308-8fa2-e3b0836f2cc3 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:20.413072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fc01e384-a6e5-4308-8fa2-e3b0836f2cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:20.466685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:20.485422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 50/99] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:20.817972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4013768-1994-486b-ae0d-b6f04b5757a0 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:20.933291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4013768-1994-486b-ae0d-b6f04b5757a0 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:20.979809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447a86-eb97-4ce3-97e4-63e8df645202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:20.980470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447a86-eb97-4ce3-97e4-63e8df645202 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:20.980752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447a86-eb97-4ce3-97e4-63e8df645202 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:20.981027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447a86-eb97-4ce3-97e4-63e8df645202 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:20.998957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a447a86-eb97-4ce3-97e4-63e8df645202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-7a447a86-eb97-4ce3-97e4-63e8df645202 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:21.004076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:21.004946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:21.005791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 50/100] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:21.011223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e384-a6e5-4308-8fa2-e3b0836f2cc3 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:21.031369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c90e6f-739d-46f2-8e72-21cf4998da40 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:21.031767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c90e6f-739d-46f2-8e72-21cf4998da40 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:21.031914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c90e6f-739d-46f2-8e72-21cf4998da40 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:21.033676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 51/101] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:21.039335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff8e7b-c135-40f9-8e13-58bf06c6862f None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:21.039624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff8e7b-c135-40f9-8e13-58bf06c6862f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:21.039903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff8e7b-c135-40f9-8e13-58bf06c6862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:21.068254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-49ff8e7b-c135-40f9-8e13-58bf06c6862f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:21.069466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-49ff8e7b-c135-40f9-8e13-58bf06c6862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:21.127507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:21.209753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 52/102] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:21.210938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11bb2-7df7-4800-abe2-3fd4a14ffcf7 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:21.211226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11bb2-7df7-4800-abe2-3fd4a14ffcf7 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:21.211499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11bb2-7df7-4800-abe2-3fd4a14ffcf7 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:21.212725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 53/103] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:21.219381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64dbba-a537-4782-9c0e-75870d944ad8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:21.221555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e384-a6e5-4308-8fa2-e3b0836f2cc3 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:21.223273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64dbba-a537-4782-9c0e-75870d944ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:21.223687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64dbba-a537-4782-9c0e-75870d944ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:21.249530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-7d64dbba-a537-4782-9c0e-75870d944ad8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:21.250791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7d64dbba-a537-4782-9c0e-75870d944ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:21.296551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f95a-bd36-422a-a756-7c47636e18b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:21.297193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f95a-bd36-422a-a756-7c47636e18b3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:21.297510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f95a-bd36-422a-a756-7c47636e18b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:21.297792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f95a-bd36-422a-a756-7c47636e18b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:21.298477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0f95a-bd36-422a-a756-7c47636e18b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:21.298785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0f95a-bd36-422a-a756-7c47636e18b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:21.300179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0f95a-bd36-422a-a756-7c47636e18b3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:21.316947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 51/104] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:21.322703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f95a-bd36-422a-a756-7c47636e18b3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:21.331303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 54/105] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:21.400927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:21.473384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f95a-bd36-422a-a756-7c47636e18b3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:21.513028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4cf47-6700-4b65-a322-1bbab55ca97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:21.514027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4cf47-6700-4b65-a322-1bbab55ca97c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:21.514468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4cf47-6700-4b65-a322-1bbab55ca97c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:21.514914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4cf47-6700-4b65-a322-1bbab55ca97c None admin] PATH_INFO: `/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:21.516182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4cf47-6700-4b65-a322-1bbab55ca97c None admin] RBAC: Authorizing `identity:get_user(user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:21.517804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4cf47-6700-4b65-a322-1bbab55ca97c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:21.519532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 52/106] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:21 2022] GET /identity/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:21.525228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64dbba-a537-4782-9c0e-75870d944ad8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:21.648752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:21.663565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64dbba-a537-4782-9c0e-75870d944ad8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:21.726546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618bcf1-d68e-4be0-8f4d-23d31bbe5951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:21.727132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618bcf1-d68e-4be0-8f4d-23d31bbe5951 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:21.727421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618bcf1-d68e-4be0-8f4d-23d31bbe5951 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:21.727705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618bcf1-d68e-4be0-8f4d-23d31bbe5951 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:21.729016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618bcf1-d68e-4be0-8f4d-23d31bbe5951 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:21.730523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618bcf1-d68e-4be0-8f4d-23d31bbe5951 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:21.732615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 55/107] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:21 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:21.738645 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4cf47-6700-4b65-a322-1bbab55ca97c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:21.754530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618bcf1-d68e-4be0-8f4d-23d31bbe5951 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:21.885858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4cf47-6700-4b65-a322-1bbab55ca97c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:21.902398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:21.923647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618bcf1-d68e-4be0-8f4d-23d31bbe5951 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:21.931330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba49d03-43e1-499c-88de-4cbc463697bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:21.932725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba49d03-43e1-499c-88de-4cbc463697bf None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:21.933089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba49d03-43e1-499c-88de-4cbc463697bf None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:21.933491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba49d03-43e1-499c-88de-4cbc463697bf None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4/users/2e5c72c28f2c4b5fbd6dab7c0388fba6/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:21.936046 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba49d03-43e1-499c-88de-4cbc463697bf None admin] RBAC: Authorizing `identity:create_grant(project_id=5039b090c00e4b52901878d5da90d9a4, user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:21.938427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba49d03-43e1-499c-88de-4cbc463697bf None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:21.957927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 53/108] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:11:21 2022] PUT /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4/users/2e5c72c28f2c4b5fbd6dab7c0388fba6/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:11:21.959233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba49d03-43e1-499c-88de-4cbc463697bf None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:21.970649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd1d0b-77ef-4600-a8a0-96323080786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:21.972184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1d0b-77ef-4600-a8a0-96323080786f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:21.972551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1d0b-77ef-4600-a8a0-96323080786f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:21.972960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd1d0b-77ef-4600-a8a0-96323080786f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:21.990517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd1d0b-77ef-4600-a8a0-96323080786f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-f3dd1d0b-77ef-4600-a8a0-96323080786f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:21.997891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:21.999747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:22.000509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 56/109] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:22.001112 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71abb9-5a5a-42c1-8d2b-151648ba980b None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:22.001112 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71abb9-5a5a-42c1-8d2b-151648ba980b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:22.001766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71abb9-5a5a-42c1-8d2b-151648ba980b None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:22.004717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 57/110] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:22.010585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71abb9-5a5a-42c1-8d2b-151648ba980b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:22.043204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:22.119385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba49d03-43e1-499c-88de-4cbc463697bf None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:22.145740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71abb9-5a5a-42c1-8d2b-151648ba980b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:22.173899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e4bd2-dacb-4ab3-b717-86fb3f980a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:22.175093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e4bd2-dacb-4ab3-b717-86fb3f980a1d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:22.175469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e4bd2-dacb-4ab3-b717-86fb3f980a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:22.175827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e4bd2-dacb-4ab3-b717-86fb3f980a1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:22.177620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e4bd2-dacb-4ab3-b717-86fb3f980a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:22.180221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e4bd2-dacb-4ab3-b717-86fb3f980a1d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:22.182678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 54/111] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:22.188099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475a1af-ad44-4bc7-b41c-345aa76dee1e None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:22.188099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475a1af-ad44-4bc7-b41c-345aa76dee1e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:22.188099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475a1af-ad44-4bc7-b41c-345aa76dee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:22.199474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f429-b8f6-408d-a83a-c682502bfc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:22.200932 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f429-b8f6-408d-a83a-c682502bfc4a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:22.201566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f429-b8f6-408d-a83a-c682502bfc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:22.202050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f429-b8f6-408d-a83a-c682502bfc4a None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:22.203576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f429-b8f6-408d-a83a-c682502bfc4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:22.204146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f429-b8f6-408d-a83a-c682502bfc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:22.205910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f429-b8f6-408d-a83a-c682502bfc4a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:22.208136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4475a1af-ad44-4bc7-b41c-345aa76dee1e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:22.210193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4475a1af-ad44-4bc7-b41c-345aa76dee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:22.220562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 58/112] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:22.222264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f429-b8f6-408d-a83a-c682502bfc4a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:22.259709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:22.308042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 55/113] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:22.309190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475a1af-ad44-4bc7-b41c-345aa76dee1e None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:22.357025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:22.375147 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f429-b8f6-408d-a83a-c682502bfc4a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:22.415577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff8a55-0eb3-4c8c-a439-960c22eea7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:22.416211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff8a55-0eb3-4c8c-a439-960c22eea7bd None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:22.416525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff8a55-0eb3-4c8c-a439-960c22eea7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:22.416905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff8a55-0eb3-4c8c-a439-960c22eea7bd None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:22.417736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff8a55-0eb3-4c8c-a439-960c22eea7bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:22.419356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff8a55-0eb3-4c8c-a439-960c22eea7bd None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:22.451076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475a1af-ad44-4bc7-b41c-345aa76dee1e None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:22.462443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 59/114] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:11:22 2022] POST /identity/v3/projects => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:22.464041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0abef6-923a-423b-be29-0adff5925fe5 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:22.464478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0abef6-923a-423b-be29-0adff5925fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:22.464818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0abef6-923a-423b-be29-0adff5925fe5 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:22.470676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 60/115] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:22.488815 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30410b-70f8-4d68-b81a-43135807c26f None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:22.489151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30410b-70f8-4d68-b81a-43135807c26f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:22.489466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30410b-70f8-4d68-b81a-43135807c26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:22.501103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aac4e-3422-4190-9092-1ab31a596b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:22.501960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aac4e-3422-4190-9092-1ab31a596b1a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:22.502377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aac4e-3422-4190-9092-1ab31a596b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:22.502753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aac4e-3422-4190-9092-1ab31a596b1a None admin] PATH_INFO: `/v3/users/fecdc974429144789e83b96710d24be9` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:22.522121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aac4e-3422-4190-9092-1ab31a596b1a None admin] RBAC: Authorizing `identity:get_user(user_id=fecdc974429144789e83b96710d24be9)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:22.524137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aac4e-3422-4190-9092-1ab31a596b1a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:22.526315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 56/116] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:22 2022] GET /identity/v3/users/fecdc974429144789e83b96710d24be9 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:22.528595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-0f30410b-70f8-4d68-b81a-43135807c26f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:22.529844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-0f30410b-70f8-4d68-b81a-43135807c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:22.532709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aac4e-3422-4190-9092-1ab31a596b1a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:22.594598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:22.730327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 61/117] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:22.732477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aac4e-3422-4190-9092-1ab31a596b1a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:22.785871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a60c8-0338-4ed2-9d1e-f527491e2ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:22.786719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a60c8-0338-4ed2-9d1e-f527491e2ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:22.787168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a60c8-0338-4ed2-9d1e-f527491e2ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:22.787591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a60c8-0338-4ed2-9d1e-f527491e2ea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:22.807874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30410b-70f8-4d68-b81a-43135807c26f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:22.906472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:22.926659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a60c8-0338-4ed2-9d1e-f527491e2ea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:22.928229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a60c8-0338-4ed2-9d1e-f527491e2ea2 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:22.971527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30410b-70f8-4d68-b81a-43135807c26f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:22.987219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:23.052495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceda8e4-5bdd-4656-80ed-2d1cf594a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:23.053065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceda8e4-5bdd-4656-80ed-2d1cf594a5ea None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.053372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceda8e4-5bdd-4656-80ed-2d1cf594a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.055123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceda8e4-5bdd-4656-80ed-2d1cf594a5ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.075163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceda8e4-5bdd-4656-80ed-2d1cf594a5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-9ceda8e4-5bdd-4656-80ed-2d1cf594a5ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:23.080193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:23.081038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:23.081810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 62/118] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:11:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:23.082917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68589016-6074-45a8-ae3c-eba5bef8dcae None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.082917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68589016-6074-45a8-ae3c-eba5bef8dcae None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.083261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68589016-6074-45a8-ae3c-eba5bef8dcae None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.085537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 63/119] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:23.086440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68589016-6074-45a8-ae3c-eba5bef8dcae None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:23.113008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 57/120] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 18:11:23.114371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a60c8-0338-4ed2-9d1e-f527491e2ea2 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:23.200748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68589016-6074-45a8-ae3c-eba5bef8dcae None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:23.232811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:23.242870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87315d-e227-448b-9e06-d737586c4746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:23.243530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87315d-e227-448b-9e06-d737586c4746 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.243894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87315d-e227-448b-9e06-d737586c4746 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.244253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87315d-e227-448b-9e06-d737586c4746 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.255976 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87315d-e227-448b-9e06-d737586c4746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-ab87315d-e227-448b-9e06-d737586c4746 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:23.261040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:23.261928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:23.262666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 64/121] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:23.267877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a60c8-0338-4ed2-9d1e-f527491e2ea2 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:23.268894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f7a4-4604-4a3a-bb31-1b90afd3ea6a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.269290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f7a4-4604-4a3a-bb31-1b90afd3ea6a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.269657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f7a4-4604-4a3a-bb31-1b90afd3ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.289225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d3f0f7a4-4604-4a3a-bb31-1b90afd3ea6a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:23.290562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d3f0f7a4-4604-4a3a-bb31-1b90afd3ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:23.303863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:23.308978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75504a-d3c2-4933-9819-1999ac1cef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:23.310037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75504a-d3c2-4933-9819-1999ac1cef01 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.310527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75504a-d3c2-4933-9819-1999ac1cef01 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.311019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75504a-d3c2-4933-9819-1999ac1cef01 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.311904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75504a-d3c2-4933-9819-1999ac1cef01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:23.312404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75504a-d3c2-4933-9819-1999ac1cef01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:23.314172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75504a-d3c2-4933-9819-1999ac1cef01 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:23.324231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 58/122] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:23.325539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75504a-d3c2-4933-9819-1999ac1cef01 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:23.363586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 65/123] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:23.364590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f7a4-4604-4a3a-bb31-1b90afd3ea6a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:23.436928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75504a-d3c2-4933-9819-1999ac1cef01 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:23.475765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5aa891-116e-435c-96ea-6e4707e74185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:23.477278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5aa891-116e-435c-96ea-6e4707e74185 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.477454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f7a4-4604-4a3a-bb31-1b90afd3ea6a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:23.477926 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5aa891-116e-435c-96ea-6e4707e74185 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.478398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5aa891-116e-435c-96ea-6e4707e74185 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.480074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5aa891-116e-435c-96ea-6e4707e74185 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:23.481810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5aa891-116e-435c-96ea-6e4707e74185 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:23.483740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 59/124] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:23.484708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5aa891-116e-435c-96ea-6e4707e74185 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:23.496646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:23.516872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27022b8-48b8-46b9-bf62-6b7c221c0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:23.517533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27022b8-48b8-46b9-bf62-6b7c221c0e5f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.517824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27022b8-48b8-46b9-bf62-6b7c221c0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.518108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27022b8-48b8-46b9-bf62-6b7c221c0e5f None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.518901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27022b8-48b8-46b9-bf62-6b7c221c0e5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:23.519217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27022b8-48b8-46b9-bf62-6b7c221c0e5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:23.520729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27022b8-48b8-46b9-bf62-6b7c221c0e5f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:23.536105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 66/125] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:23.536899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27022b8-48b8-46b9-bf62-6b7c221c0e5f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:23.603397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:23.649746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5aa891-116e-435c-96ea-6e4707e74185 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:23.654179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27022b8-48b8-46b9-bf62-6b7c221c0e5f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:23.686320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3707a1a-2f4a-40dd-98b8-b60fd67986f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:23.687869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3707a1a-2f4a-40dd-98b8-b60fd67986f0 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.688351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3707a1a-2f4a-40dd-98b8-b60fd67986f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.688917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3707a1a-2f4a-40dd-98b8-b60fd67986f0 None admin] PATH_INFO: `/v3/users/049d44343a884314a11942aecf5771ab` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.690291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3707a1a-2f4a-40dd-98b8-b60fd67986f0 None admin] RBAC: Authorizing `identity:get_user(user_id=049d44343a884314a11942aecf5771ab)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:23.692152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3707a1a-2f4a-40dd-98b8-b60fd67986f0 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:23.694125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 60/126] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/users/049d44343a884314a11942aecf5771ab => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:23.695190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3707a1a-2f4a-40dd-98b8-b60fd67986f0 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:23.700238 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c95a2-d5b9-4663-91ff-a25844bc61cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:23.700902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c95a2-d5b9-4663-91ff-a25844bc61cb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.701195 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c95a2-d5b9-4663-91ff-a25844bc61cb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.701509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c95a2-d5b9-4663-91ff-a25844bc61cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.702318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c95a2-d5b9-4663-91ff-a25844bc61cb None admin] RBAC: Adding query filter params (role.id=8449438b350d420cb4d3a8450c21a891, scope.project.id=5039b090c00e4b52901878d5da90d9a4, user.id=fecdc974429144789e83b96710d24be9) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:23.702638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c95a2-d5b9-4663-91ff-a25844bc61cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:23.704079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c95a2-d5b9-4663-91ff-a25844bc61cb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:23.710674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 67/127] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/role_assignments?user.id=fecdc974429144789e83b96710d24be9&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=8449438b350d420cb4d3a8450c21a891 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:23.711566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c95a2-d5b9-4663-91ff-a25844bc61cb None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:23.766927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:23.816782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3707a1a-2f4a-40dd-98b8-b60fd67986f0 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:23.833919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c95a2-d5b9-4663-91ff-a25844bc61cb None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:23.848524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:23.866949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b192f77-0bd8-4435-869b-6a0b22f634b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:23.868210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b192f77-0bd8-4435-869b-6a0b22f634b9 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.868724 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b192f77-0bd8-4435-869b-6a0b22f634b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.869212 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b192f77-0bd8-4435-869b-6a0b22f634b9 None admin] PATH_INFO: `/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.874219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b192f77-0bd8-4435-869b-6a0b22f634b9 None admin] RBAC: Authorizing `identity:get_user(user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:23.876202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b192f77-0bd8-4435-869b-6a0b22f634b9 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:23.884644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 61/128] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:23.886079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b192f77-0bd8-4435-869b-6a0b22f634b9 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:23.888068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63751669-0219-45c3-a2e1-6108d4765c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:23.888753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751669-0219-45c3-a2e1-6108d4765c98 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:23.889045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751669-0219-45c3-a2e1-6108d4765c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:23.889354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751669-0219-45c3-a2e1-6108d4765c98 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:23.892970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63751669-0219-45c3-a2e1-6108d4765c98 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:23.894493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63751669-0219-45c3-a2e1-6108d4765c98 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:23.896240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 68/129] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:23.899295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63751669-0219-45c3-a2e1-6108d4765c98 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:24.059515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63751669-0219-45c3-a2e1-6108d4765c98 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:24.071466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b192f77-0bd8-4435-869b-6a0b22f634b9 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:24.087261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:24.122686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc96805-c347-4164-9ea3-7132f4a9729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:24.123257 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc96805-c347-4164-9ea3-7132f4a9729d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:24.123546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc96805-c347-4164-9ea3-7132f4a9729d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:24.123826 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc96805-c347-4164-9ea3-7132f4a9729d None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:24.126345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc96805-c347-4164-9ea3-7132f4a9729d None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:24.127812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc96805-c347-4164-9ea3-7132f4a9729d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:24.129658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 69/130] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:24.130241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc96805-c347-4164-9ea3-7132f4a9729d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:24.135330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce3263-08e6-4eac-92dc-6526410a918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:24.135982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce3263-08e6-4eac-92dc-6526410a918b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:24.136269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce3263-08e6-4eac-92dc-6526410a918b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:24.136550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce3263-08e6-4eac-92dc-6526410a918b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:24.159008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce3263-08e6-4eac-92dc-6526410a918b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-19ce3263-08e6-4eac-92dc-6526410a918b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:24.164471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:24.165401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:24.166187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 62/131] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:24.166842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce3263-08e6-4eac-92dc-6526410a918b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:24.289868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:24.329483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc96805-c347-4164-9ea3-7132f4a9729d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:24.372245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce3263-08e6-4eac-92dc-6526410a918b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:24.394788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760618-4a1b-4b78-b9bb-d97b3e35cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:24.396356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760618-4a1b-4b78-b9bb-d97b3e35cdb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:24.396854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760618-4a1b-4b78-b9bb-d97b3e35cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:24.397645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760618-4a1b-4b78-b9bb-d97b3e35cdb5 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4/users/049d44343a884314a11942aecf5771ab/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:24.403920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40760618-4a1b-4b78-b9bb-d97b3e35cdb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5039b090c00e4b52901878d5da90d9a4, user_id=049d44343a884314a11942aecf5771ab, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:24.406446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40760618-4a1b-4b78-b9bb-d97b3e35cdb5 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:24.411012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ee54-fb20-4cec-b65c-a3770c71089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:24.412122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ee54-fb20-4cec-b65c-a3770c71089f None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:24.412457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ee54-fb20-4cec-b65c-a3770c71089f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:24.413133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516ee54-fb20-4cec-b65c-a3770c71089f None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4/users/2e5c72c28f2c4b5fbd6dab7c0388fba6/roles/3ba0b7b6bdc646f586a35aafc5c739f2` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:24.419259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516ee54-fb20-4cec-b65c-a3770c71089f None admin] RBAC: Authorizing `identity:create_grant(project_id=5039b090c00e4b52901878d5da90d9a4, user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6, role_id=3ba0b7b6bdc646f586a35aafc5c739f2)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:24.421225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516ee54-fb20-4cec-b65c-a3770c71089f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:24.434740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 70/132] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:11:24 2022] PUT /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4/users/049d44343a884314a11942aecf5771ab/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:11:24.437036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760618-4a1b-4b78-b9bb-d97b3e35cdb5 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:24.451400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 63/133] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:11:24 2022] PUT /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4/users/2e5c72c28f2c4b5fbd6dab7c0388fba6/roles/3ba0b7b6bdc646f586a35aafc5c739f2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:11:24.569701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:24.696669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760618-4a1b-4b78-b9bb-d97b3e35cdb5 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:24.779566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17c4af-2ac6-43b7-b532-c550ce6cb934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:24.780255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17c4af-2ac6-43b7-b532-c550ce6cb934 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:24.781068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17c4af-2ac6-43b7-b532-c550ce6cb934 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:24.781379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17c4af-2ac6-43b7-b532-c550ce6cb934 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:24.782082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17c4af-2ac6-43b7-b532-c550ce6cb934 None admin] RBAC: Adding query filter params (name=member) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:24.782389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17c4af-2ac6-43b7-b532-c550ce6cb934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:24.783817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17c4af-2ac6-43b7-b532-c550ce6cb934 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:24.801032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 71/134] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:24.810571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ee54-fb20-4cec-b65c-a3770c71089f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:25.057271 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516ee54-fb20-4cec-b65c-a3770c71089f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:25.098064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:25.116490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da53dc-a090-466c-ad16-613f7cd6046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:25.117140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da53dc-a090-466c-ad16-613f7cd6046e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:25.117459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da53dc-a090-466c-ad16-613f7cd6046e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:25.117719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da53dc-a090-466c-ad16-613f7cd6046e None admin] PATH_INFO: `/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:25.118845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da53dc-a090-466c-ad16-613f7cd6046e None admin] RBAC: Authorizing `identity:get_user(user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:25.120313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da53dc-a090-466c-ad16-613f7cd6046e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:25.122361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 64/135] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:24 2022] GET /identity/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:25.130441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17c4af-2ac6-43b7-b532-c550ce6cb934 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:25.255146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b5a9a-753f-468e-b4a8-127242d5558e None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:25.255480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b5a9a-753f-468e-b4a8-127242d5558e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:25.255707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b5a9a-753f-468e-b4a8-127242d5558e None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:25.257263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 65/136] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:25.262333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08e63-c68a-4f46-bfad-4ba213650d2d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:25.262653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08e63-c68a-4f46-bfad-4ba213650d2d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:25.262894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08e63-c68a-4f46-bfad-4ba213650d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:25.271718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17c4af-2ac6-43b7-b532-c550ce6cb934 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:25.277559 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:25.290900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3bf08e63-c68a-4f46-bfad-4ba213650d2d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:25.292106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3bf08e63-c68a-4f46-bfad-4ba213650d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:25.346620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ce019-7af8-410a-b65d-bc69af32610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:25.347638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ce019-7af8-410a-b65d-bc69af32610e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:25.348129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ce019-7af8-410a-b65d-bc69af32610e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:25.348627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ce019-7af8-410a-b65d-bc69af32610e None admin] PATH_INFO: `/v3/projects/0f2ea7cbd48a4cddb7f8f3290d22678c` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:25.353999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ce019-7af8-410a-b65d-bc69af32610e None admin] RBAC: Authorizing `identity:get_project(project_id=0f2ea7cbd48a4cddb7f8f3290d22678c)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:25.355733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ce019-7af8-410a-b65d-bc69af32610e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:25.358008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 72/137] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:25 2022] GET /identity/v3/projects/0f2ea7cbd48a4cddb7f8f3290d22678c => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:25.364047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ce019-7af8-410a-b65d-bc69af32610e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:25.433103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 66/138] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:25.560864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ce019-7af8-410a-b65d-bc69af32610e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:25.611707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa6d4-c3d4-4421-87a0-a752767c40b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:25.613171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa6d4-c3d4-4421-87a0-a752767c40b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:25.613699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa6d4-c3d4-4421-87a0-a752767c40b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:25.614198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa6d4-c3d4-4421-87a0-a752767c40b0 None admin] PATH_INFO: `/v3/projects/0f2ea7cbd48a4cddb7f8f3290d22678c/users/2e5c72c28f2c4b5fbd6dab7c0388fba6/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:25.617695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa6d4-c3d4-4421-87a0-a752767c40b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2ea7cbd48a4cddb7f8f3290d22678c, user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:25.619428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa6d4-c3d4-4421-87a0-a752767c40b0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:25.637000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 73/139] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:11:25 2022] PUT /identity/v3/projects/0f2ea7cbd48a4cddb7f8f3290d22678c/users/2e5c72c28f2c4b5fbd6dab7c0388fba6/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:11:25.741662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3607-8c7e-42a1-9916-782ea33cfe9f None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:25.742000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3607-8c7e-42a1-9916-782ea33cfe9f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:25.742275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3607-8c7e-42a1-9916-782ea33cfe9f None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:25.744015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 67/140] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:25.762630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eee23-36bd-4dd8-be15-970665a05b92 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:25.763285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eee23-36bd-4dd8-be15-970665a05b92 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:25.763785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eee23-36bd-4dd8-be15-970665a05b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:25.794511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-aa8eee23-36bd-4dd8-be15-970665a05b92 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:25.796224 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-aa8eee23-36bd-4dd8-be15-970665a05b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:25.829977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:25.892085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 74/141] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:25.910769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c3607-8c7e-42a1-9916-782ea33cfe9f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:26.054712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c3607-8c7e-42a1-9916-782ea33cfe9f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:26.069832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:26.100702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3eb68-ec61-4576-ba6d-ba12d960d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:26.101369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3eb68-ec61-4576-ba6d-ba12d960d2bd None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:26.101654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3eb68-ec61-4576-ba6d-ba12d960d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:26.101927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3eb68-ec61-4576-ba6d-ba12d960d2bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:26.118472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3eb68-ec61-4576-ba6d-ba12d960d2bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-93c3eb68-ec61-4576-ba6d-ba12d960d2bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:26.123316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:26.124193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:26.124928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 68/142] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:26.131793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eee23-36bd-4dd8-be15-970665a05b92 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:26.302455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eee23-36bd-4dd8-be15-970665a05b92 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:26.326362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3eb68-ec61-4576-ba6d-ba12d960d2bd None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:26.349274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307871f6-9264-4b4d-a784-f530fbbac878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:26.349945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307871f6-9264-4b4d-a784-f530fbbac878 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:26.350238 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307871f6-9264-4b4d-a784-f530fbbac878 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:26.350526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307871f6-9264-4b4d-a784-f530fbbac878 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:26.351277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307871f6-9264-4b4d-a784-f530fbbac878 None admin] RBAC: Adding query filter params (name=member) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:26.351592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307871f6-9264-4b4d-a784-f530fbbac878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:26.353084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307871f6-9264-4b4d-a784-f530fbbac878 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:26.370244 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 75/143] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:26.375315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307871f6-9264-4b4d-a784-f530fbbac878 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:26.421824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:26.537834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3eb68-ec61-4576-ba6d-ba12d960d2bd None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:26.578997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307871f6-9264-4b4d-a784-f530fbbac878 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:26.582736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c2090-63ee-4296-bef7-a5666ccfc4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:26.583927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c2090-63ee-4296-bef7-a5666ccfc4fa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:26.584456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c2090-63ee-4296-bef7-a5666ccfc4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:26.584923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c2090-63ee-4296-bef7-a5666ccfc4fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:26.587201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c2090-63ee-4296-bef7-a5666ccfc4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:26.589069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c2090-63ee-4296-bef7-a5666ccfc4fa None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:26.593585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 69/144] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:26.603245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c2090-63ee-4296-bef7-a5666ccfc4fa None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:26.657531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72885e3b-9a6b-4c5b-aba8-6e56308fb4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:26.658908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72885e3b-9a6b-4c5b-aba8-6e56308fb4fe None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:26.659416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72885e3b-9a6b-4c5b-aba8-6e56308fb4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:26.659903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72885e3b-9a6b-4c5b-aba8-6e56308fb4fe None admin] PATH_INFO: `/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:26.663072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72885e3b-9a6b-4c5b-aba8-6e56308fb4fe None admin] RBAC: Authorizing `identity:get_user(user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:26.664786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72885e3b-9a6b-4c5b-aba8-6e56308fb4fe None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:26.668427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 76/145] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:26 2022] GET /identity/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:26.677466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72885e3b-9a6b-4c5b-aba8-6e56308fb4fe None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:26.701392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:26.831848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c2090-63ee-4296-bef7-a5666ccfc4fa None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:26.840954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:26.853838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72885e3b-9a6b-4c5b-aba8-6e56308fb4fe None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:26.897048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93632252-685f-48aa-946c-d11e6be5d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:26.898130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93632252-685f-48aa-946c-d11e6be5d499 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:26.898419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93632252-685f-48aa-946c-d11e6be5d499 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:26.898689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93632252-685f-48aa-946c-d11e6be5d499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:26.914665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74521ca-5738-47a9-94e8-f7b1b91a8176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:26.915349 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74521ca-5738-47a9-94e8-f7b1b91a8176 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:26.915579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74521ca-5738-47a9-94e8-f7b1b91a8176 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:26.915850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74521ca-5738-47a9-94e8-f7b1b91a8176 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:26.916529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74521ca-5738-47a9-94e8-f7b1b91a8176 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:26.918030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74521ca-5738-47a9-94e8-f7b1b91a8176 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:26.956207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 70/146] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:11:26 2022] POST /identity/v3/users => generated 283 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:27.017272 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93632252-685f-48aa-946c-d11e6be5d499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:27.018767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93632252-685f-48aa-946c-d11e6be5d499 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:27.066875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03747d9-31a6-4a45-af2e-1de5c40ea502 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:27.067204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03747d9-31a6-4a45-af2e-1de5c40ea502 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:27.067454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03747d9-31a6-4a45-af2e-1de5c40ea502 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:27.069032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 71/147] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:27.079391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120c0c2-9473-43f9-bd9b-87e1088d29ed None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:27.079751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120c0c2-9473-43f9-bd9b-87e1088d29ed None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:27.079931 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120c0c2-9473-43f9-bd9b-87e1088d29ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:27.110130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-7120c0c2-9473-43f9-bd9b-87e1088d29ed None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:27.111257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7120c0c2-9473-43f9-bd9b-87e1088d29ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:27.182677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:27.190975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 77/148] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 18:11:27.196952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93632252-685f-48aa-946c-d11e6be5d499 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:27.256489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 72/149] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:27.337203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93632252-685f-48aa-946c-d11e6be5d499 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:27.380877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61d60c-5024-4795-b878-1be95b547e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:27.381466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61d60c-5024-4795-b878-1be95b547e07 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:27.381747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61d60c-5024-4795-b878-1be95b547e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:27.382159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61d60c-5024-4795-b878-1be95b547e07 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:27.383315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61d60c-5024-4795-b878-1be95b547e07 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:27.384769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61d60c-5024-4795-b878-1be95b547e07 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:27.386858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 78/150] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:27 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:27.392902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120c0c2-9473-43f9-bd9b-87e1088d29ed None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:27.438161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:27.526309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120c0c2-9473-43f9-bd9b-87e1088d29ed None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:27.568839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87df047-1035-47fa-8f75-abbe6c8f17b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:27.569488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df047-1035-47fa-8f75-abbe6c8f17b7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:27.569771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df047-1035-47fa-8f75-abbe6c8f17b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:27.570044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df047-1035-47fa-8f75-abbe6c8f17b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:27.570784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87df047-1035-47fa-8f75-abbe6c8f17b7 None admin] RBAC: Adding query filter params (role.id=7c59786364c04f0087154923c39fa449, scope.project.id=5039b090c00e4b52901878d5da90d9a4, user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:27.571151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87df047-1035-47fa-8f75-abbe6c8f17b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:27.572602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87df047-1035-47fa-8f75-abbe6c8f17b7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:27.579433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 73/151] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:27 2022] GET /identity/v3/role_assignments?user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=7c59786364c04f0087154923c39fa449 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:27.587063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61d60c-5024-4795-b878-1be95b547e07 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:27.684015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:27.742225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61d60c-5024-4795-b878-1be95b547e07 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:27.790088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c994be0-b029-459f-a5da-5800978d4cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:27.790791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c994be0-b029-459f-a5da-5800978d4cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:27.791072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c994be0-b029-459f-a5da-5800978d4cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:27.791355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c994be0-b029-459f-a5da-5800978d4cd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:27.805677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c994be0-b029-459f-a5da-5800978d4cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-4c994be0-b029-459f-a5da-5800978d4cd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:27.810655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:27.811530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:27.813229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 79/152] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:27.818405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87df047-1035-47fa-8f75-abbe6c8f17b7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:27.948488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:27.959842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87df047-1035-47fa-8f75-abbe6c8f17b7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:28.007074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49bdeb-a66a-4520-ba17-c5de8da40ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:28.007718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49bdeb-a66a-4520-ba17-c5de8da40ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:28.008000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49bdeb-a66a-4520-ba17-c5de8da40ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:28.008274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49bdeb-a66a-4520-ba17-c5de8da40ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:28.008970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49bdeb-a66a-4520-ba17-c5de8da40ac6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:28.009297 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49bdeb-a66a-4520-ba17-c5de8da40ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:28.010739 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49bdeb-a66a-4520-ba17-c5de8da40ac6 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:28.022042 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b261a89-4b23-4e58-85ca-f6fae0aece44 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:28.022334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b261a89-4b23-4e58-85ca-f6fae0aece44 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:28.022610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b261a89-4b23-4e58-85ca-f6fae0aece44 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:28.024238 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 80/153] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:28.027729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 74/154] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:28.033199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde67f-7c05-4109-8ae4-491bb020425d None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:28.033536 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde67f-7c05-4109-8ae4-491bb020425d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:28.033784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde67f-7c05-4109-8ae4-491bb020425d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:28.038843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49bdeb-a66a-4520-ba17-c5de8da40ac6 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:28.062399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b3bde67f-7c05-4109-8ae4-491bb020425d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:28.065806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b3bde67f-7c05-4109-8ae4-491bb020425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:28.177168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 81/155] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:28.182649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3faf74-7ece-4301-81a2-6bb3c77518b3 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:28.188558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3faf74-7ece-4301-81a2-6bb3c77518b3 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:28.189101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3faf74-7ece-4301-81a2-6bb3c77518b3 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:28.190810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 82/156] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:28.196475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e886539-1ee2-48d5-bf1f-2fa57dfd8953 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:28.197012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e886539-1ee2-48d5-bf1f-2fa57dfd8953 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:28.197512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e886539-1ee2-48d5-bf1f-2fa57dfd8953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:28.227572 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-2e886539-1ee2-48d5-bf1f-2fa57dfd8953 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:28.229279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2e886539-1ee2-48d5-bf1f-2fa57dfd8953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:28.255107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49bdeb-a66a-4520-ba17-c5de8da40ac6 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:28.316306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:28.326980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e17333-b7b7-40a5-bed7-ddf5839ea8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:28.328528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e17333-b7b7-40a5-bed7-ddf5839ea8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:28.329536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e17333-b7b7-40a5-bed7-ddf5839ea8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:28.330039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e17333-b7b7-40a5-bed7-ddf5839ea8f5 None admin] PATH_INFO: `/v3/users/fecdc974429144789e83b96710d24be9` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:28.335528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e17333-b7b7-40a5-bed7-ddf5839ea8f5 None admin] RBAC: Authorizing `identity:get_user(user_id=fecdc974429144789e83b96710d24be9)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:28.337762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e17333-b7b7-40a5-bed7-ddf5839ea8f5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:28.339699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 75/157] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:28 2022] GET /identity/v3/users/fecdc974429144789e83b96710d24be9 => generated 289 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:28.345754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e17333-b7b7-40a5-bed7-ddf5839ea8f5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:28.366701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 83/158] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:28.386616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:28.486178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e17333-b7b7-40a5-bed7-ddf5839ea8f5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:28.531178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25433a60-3547-464e-b066-48eaa9b2d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:28.532160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25433a60-3547-464e-b066-48eaa9b2d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:28.532679 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25433a60-3547-464e-b066-48eaa9b2d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:28.533156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25433a60-3547-464e-b066-48eaa9b2d2d9 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:28.538018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25433a60-3547-464e-b066-48eaa9b2d2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:28.540064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25433a60-3547-464e-b066-48eaa9b2d2d9 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:28.542045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 76/159] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:28 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:28.548492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e886539-1ee2-48d5-bf1f-2fa57dfd8953 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:28.616640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25433a60-3547-464e-b066-48eaa9b2d2d9 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:28.702304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e886539-1ee2-48d5-bf1f-2fa57dfd8953 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:28.770138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5159c3-23e7-4dd1-87e3-87a62106b175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:28.770736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5159c3-23e7-4dd1-87e3-87a62106b175 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:28.771014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5159c3-23e7-4dd1-87e3-87a62106b175 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:28.771263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5159c3-23e7-4dd1-87e3-87a62106b175 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4/users/fecdc974429144789e83b96710d24be9/roles/8449438b350d420cb4d3a8450c21a891` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:28.773395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5159c3-23e7-4dd1-87e3-87a62106b175 None admin] RBAC: Authorizing `identity:create_grant(project_id=5039b090c00e4b52901878d5da90d9a4, user_id=fecdc974429144789e83b96710d24be9, role_id=8449438b350d420cb4d3a8450c21a891)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:28.773715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:28.774873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5159c3-23e7-4dd1-87e3-87a62106b175 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:28.781256 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25433a60-3547-464e-b066-48eaa9b2d2d9 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:28.802794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 84/160] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:11:28 2022] PUT /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4/users/fecdc974429144789e83b96710d24be9/roles/8449438b350d420cb4d3a8450c21a891 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:11:28.826609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd5182-5821-49a3-8cb2-8f494b8d9119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:28.827625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5182-5821-49a3-8cb2-8f494b8d9119 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:28.828131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5182-5821-49a3-8cb2-8f494b8d9119 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:28.828573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5182-5821-49a3-8cb2-8f494b8d9119 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:28.843529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd5182-5821-49a3-8cb2-8f494b8d9119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-c1bd5182-5821-49a3-8cb2-8f494b8d9119 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:28.849480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:28.850359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:28.851103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:28.853107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 77/161] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:11:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:28.861793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5159c3-23e7-4dd1-87e3-87a62106b175 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:28.933729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:28.947880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd5182-5821-49a3-8cb2-8f494b8d9119 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:29.037129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5159c3-23e7-4dd1-87e3-87a62106b175 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:29.116869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd5182-5821-49a3-8cb2-8f494b8d9119 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:29.119420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c6694-d50c-472f-a374-dba17c7b19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:29.120060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c6694-d50c-472f-a374-dba17c7b19e1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:29.120339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c6694-d50c-472f-a374-dba17c7b19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:29.120611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c6694-d50c-472f-a374-dba17c7b19e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:29.121769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c6694-d50c-472f-a374-dba17c7b19e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:29.121769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c6694-d50c-472f-a374-dba17c7b19e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:29.122975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c6694-d50c-472f-a374-dba17c7b19e1 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:29.136974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 85/162] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:11:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:29.143107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c6694-d50c-472f-a374-dba17c7b19e1 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:29.163417 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f41ed-cea3-41fa-ab6e-67e15aa9ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:29.164492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f41ed-cea3-41fa-ab6e-67e15aa9ef01 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:29.164964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f41ed-cea3-41fa-ab6e-67e15aa9ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:29.165481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f41ed-cea3-41fa-ab6e-67e15aa9ef01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:29.201444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f41ed-cea3-41fa-ab6e-67e15aa9ef01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-aa8f41ed-cea3-41fa-ab6e-67e15aa9ef01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:29.207006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:29.207899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:29.208660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 78/163] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:29.220007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f41ed-cea3-41fa-ab6e-67e15aa9ef01 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:29.247282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:29.337701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:29.347237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c6694-d50c-472f-a374-dba17c7b19e1 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:29.426927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21539c96-1f4a-4aac-97d2-a8db042dbc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:29.427999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539c96-1f4a-4aac-97d2-a8db042dbc24 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:29.428491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539c96-1f4a-4aac-97d2-a8db042dbc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:29.429332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539c96-1f4a-4aac-97d2-a8db042dbc24 None admin] PATH_INFO: `/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:29.434314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21539c96-1f4a-4aac-97d2-a8db042dbc24 None admin] RBAC: Authorizing `identity:get_user(user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:29.436746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21539c96-1f4a-4aac-97d2-a8db042dbc24 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:29.439598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 86/164] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:29 2022] GET /identity/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:29.441186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277a873-1d02-4a3a-b863-f98677f4f219 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:29.441832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277a873-1d02-4a3a-b863-f98677f4f219 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:29.442316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277a873-1d02-4a3a-b863-f98677f4f219 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:29.443751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 87/165] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:29.450469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277a873-1d02-4a3a-b863-f98677f4f219 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:29.472283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f41ed-cea3-41fa-ab6e-67e15aa9ef01 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:29.554651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fecc8-e607-4f3b-9ba0-a9e07774de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:29.556415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fecc8-e607-4f3b-9ba0-a9e07774de5d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:29.557057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fecc8-e607-4f3b-9ba0-a9e07774de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:29.558970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fecc8-e607-4f3b-9ba0-a9e07774de5d None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:29.559881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fecc8-e607-4f3b-9ba0-a9e07774de5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:29.560378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fecc8-e607-4f3b-9ba0-a9e07774de5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:29.563365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fecc8-e607-4f3b-9ba0-a9e07774de5d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:29.580653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 79/166] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:29.582923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d2bc7-3173-4b0f-b6f9-b626d0871f3d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:29.583589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d2bc7-3173-4b0f-b6f9-b626d0871f3d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:29.585506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d2bc7-3173-4b0f-b6f9-b626d0871f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:29.622138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8b5d2bc7-3173-4b0f-b6f9-b626d0871f3d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:29.625416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8b5d2bc7-3173-4b0f-b6f9-b626d0871f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:29.661050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277a873-1d02-4a3a-b863-f98677f4f219 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:29.722320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e20cb-127c-4906-b54b-c35aebd743e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:29.723061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e20cb-127c-4906-b54b-c35aebd743e1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:29.723346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e20cb-127c-4906-b54b-c35aebd743e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:29.723621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e20cb-127c-4906-b54b-c35aebd743e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:29.751851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 80/167] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:29.752736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d2bc7-3173-4b0f-b6f9-b626d0871f3d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:29.764360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:29.810279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:29.903709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e20cb-127c-4906-b54b-c35aebd743e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:29.906302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e20cb-127c-4906-b54b-c35aebd743e1 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:30.007963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d2bc7-3173-4b0f-b6f9-b626d0871f3d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:30.075091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 88/168] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:30.080726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748a72b-6982-4a50-a600-1540234c4a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:30.081292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e20cb-127c-4906-b54b-c35aebd743e1 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:30.081399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748a72b-6982-4a50-a600-1540234c4a73 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:30.081688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748a72b-6982-4a50-a600-1540234c4a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:30.081966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748a72b-6982-4a50-a600-1540234c4a73 None admin] PATH_INFO: `/v3/users/049d44343a884314a11942aecf5771ab` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:30.083217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748a72b-6982-4a50-a600-1540234c4a73 None admin] RBAC: Authorizing `identity:get_user(user_id=049d44343a884314a11942aecf5771ab)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:30.084903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748a72b-6982-4a50-a600-1540234c4a73 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:30.087766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 81/169] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:29 2022] GET /identity/v3/users/049d44343a884314a11942aecf5771ab => generated 247 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:30.092237 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748a72b-6982-4a50-a600-1540234c4a73 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:30.154214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:30.194330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e20cb-127c-4906-b54b-c35aebd743e1 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:30.240100 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661116c-b3bd-4121-aaf0-89d823c6b9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:30.241404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661116c-b3bd-4121-aaf0-89d823c6b9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:30.241867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661116c-b3bd-4121-aaf0-89d823c6b9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:30.242343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661116c-b3bd-4121-aaf0-89d823c6b9e9 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:30.243734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661116c-b3bd-4121-aaf0-89d823c6b9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:30.245445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661116c-b3bd-4121-aaf0-89d823c6b9e9 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:30.248458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 89/170] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:30 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:30.253650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:30.257428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661116c-b3bd-4121-aaf0-89d823c6b9e9 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:30.324173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748a72b-6982-4a50-a600-1540234c4a73 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:30.366380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224c3df-fbba-4d22-882d-3ce5698233c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:30.367293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c3df-fbba-4d22-882d-3ce5698233c8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:30.367749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c3df-fbba-4d22-882d-3ce5698233c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:30.368223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224c3df-fbba-4d22-882d-3ce5698233c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:30.437750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661116c-b3bd-4121-aaf0-89d823c6b9e9 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:30.470643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224c3df-fbba-4d22-882d-3ce5698233c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:30.472577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224c3df-fbba-4d22-882d-3ce5698233c8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:30.535132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e232-68c3-4c20-9431-8b2327355b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:30.535668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e232-68c3-4c20-9431-8b2327355b1c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:30.535917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e232-68c3-4c20-9431-8b2327355b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:30.536192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e232-68c3-4c20-9431-8b2327355b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:30.536860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e232-68c3-4c20-9431-8b2327355b1c None admin] RBAC: Adding query filter params (role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=5039b090c00e4b52901878d5da90d9a4, user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:30.537169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e232-68c3-4c20-9431-8b2327355b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:30.538692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e232-68c3-4c20-9431-8b2327355b1c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:30.546872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:30.550700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 90/171] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:30 2022] GET /identity/v3/role_assignments?user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:30.551514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e232-68c3-4c20-9431-8b2327355b1c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:30.594131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:30.707232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 82/172] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 18:11:30.710753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224c3df-fbba-4d22-882d-3ce5698233c8 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:30.873291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e232-68c3-4c20-9431-8b2327355b1c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:30.961888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917146b-b9e5-4156-8235-81cfe205ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:30.963188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917146b-b9e5-4156-8235-81cfe205ad66 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:30.963727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917146b-b9e5-4156-8235-81cfe205ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:30.964345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917146b-b9e5-4156-8235-81cfe205ad66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:30.981425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224c3df-fbba-4d22-882d-3ce5698233c8 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:30.998206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917146b-b9e5-4156-8235-81cfe205ad66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-7917146b-b9e5-4156-8235-81cfe205ad66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:31.008307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:31.009207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:31.010055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 91/173] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:31.015711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917146b-b9e5-4156-8235-81cfe205ad66 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:31.054018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f5456-a8c7-4daa-96cf-be2130080d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:31.054685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5456-a8c7-4daa-96cf-be2130080d4f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:31.054966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5456-a8c7-4daa-96cf-be2130080d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:31.055241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5456-a8c7-4daa-96cf-be2130080d4f None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:31.056465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f5456-a8c7-4daa-96cf-be2130080d4f None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:31.057980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f5456-a8c7-4daa-96cf-be2130080d4f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:31.059650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 83/174] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:30 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:31.066523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f5456-a8c7-4daa-96cf-be2130080d4f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:31.126525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:31.152632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:31.212079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917146b-b9e5-4156-8235-81cfe205ad66 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:31.285615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f5456-a8c7-4daa-96cf-be2130080d4f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:31.287784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6efadb-4ef5-435e-b229-32db1c436bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:31.288415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6efadb-4ef5-435e-b229-32db1c436bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:31.288691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6efadb-4ef5-435e-b229-32db1c436bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:31.288958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6efadb-4ef5-435e-b229-32db1c436bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:31.289658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6efadb-4ef5-435e-b229-32db1c436bd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:31.289968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6efadb-4ef5-435e-b229-32db1c436bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:31.291369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6efadb-4ef5-435e-b229-32db1c436bd1 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:31.308251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 92/175] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:31.314032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6efadb-4ef5-435e-b229-32db1c436bd1 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:31.359140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1717bdb-022b-489f-a023-9ff1d815e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:31.359756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1717bdb-022b-489f-a023-9ff1d815e7df None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:31.360033 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1717bdb-022b-489f-a023-9ff1d815e7df None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:31.360303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1717bdb-022b-489f-a023-9ff1d815e7df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:31.361047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1717bdb-022b-489f-a023-9ff1d815e7df None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=5039b090c00e4b52901878d5da90d9a4, user.id=049d44343a884314a11942aecf5771ab) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:31.361375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1717bdb-022b-489f-a023-9ff1d815e7df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:31.363504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1717bdb-022b-489f-a023-9ff1d815e7df None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:31.377119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 84/176] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:31 2022] GET /identity/v3/role_assignments?user.id=049d44343a884314a11942aecf5771ab&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:31.396077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b486865-ec9f-492e-8fa3-e9e2967a5199 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:31.396696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b486865-ec9f-492e-8fa3-e9e2967a5199 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:31.397181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b486865-ec9f-492e-8fa3-e9e2967a5199 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:31.398829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 85/177] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:31.410696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495179f0-31b4-46ad-bb32-499d462497d3 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:31.412899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495179f0-31b4-46ad-bb32-499d462497d3 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:31.413532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495179f0-31b4-46ad-bb32-499d462497d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:31.452639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-495179f0-31b4-46ad-bb32-499d462497d3 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:31.454493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-495179f0-31b4-46ad-bb32-499d462497d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:31.478777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6efadb-4ef5-435e-b229-32db1c436bd1 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:31.506694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:31.527748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af69829-fa5b-4d55-8ca4-478d51c97e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:31.528410 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af69829-fa5b-4d55-8ca4-478d51c97e9d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:31.533815 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af69829-fa5b-4d55-8ca4-478d51c97e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:31.534234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af69829-fa5b-4d55-8ca4-478d51c97e9d None admin] PATH_INFO: `/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:31.535573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af69829-fa5b-4d55-8ca4-478d51c97e9d None admin] RBAC: Authorizing `identity:get_user(user_id=2e5c72c28f2c4b5fbd6dab7c0388fba6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:31.537049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af69829-fa5b-4d55-8ca4-478d51c97e9d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:31.541413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 93/178] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:31 2022] GET /identity/v3/users/2e5c72c28f2c4b5fbd6dab7c0388fba6 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:31.544681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af69829-fa5b-4d55-8ca4-478d51c97e9d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:31.598468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 86/179] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:31.673795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af69829-fa5b-4d55-8ca4-478d51c97e9d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:31.710412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f70803-8f5c-4653-a3ce-b799d04002a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:31.711049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f70803-8f5c-4653-a3ce-b799d04002a1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:31.711332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f70803-8f5c-4653-a3ce-b799d04002a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:31.711604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f70803-8f5c-4653-a3ce-b799d04002a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:31.774363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:31.786256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f70803-8f5c-4653-a3ce-b799d04002a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:31.788762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f70803-8f5c-4653-a3ce-b799d04002a1 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:31.895279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 94/180] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 18:11:31.901492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495179f0-31b4-46ad-bb32-499d462497d3 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:31.944901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:31.980317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f70803-8f5c-4653-a3ce-b799d04002a1 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:32.052121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495179f0-31b4-46ad-bb32-499d462497d3 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:32.096847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:32.108580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f70803-8f5c-4653-a3ce-b799d04002a1 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:32.113522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f449b-e11b-4c53-acbf-0a05b9223225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:32.114268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f449b-e11b-4c53-acbf-0a05b9223225 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.114553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f449b-e11b-4c53-acbf-0a05b9223225 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.114828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f449b-e11b-4c53-acbf-0a05b9223225 None admin] PATH_INFO: `/v3/projects/0f2ea7cbd48a4cddb7f8f3290d22678c` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.116075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f449b-e11b-4c53-acbf-0a05b9223225 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2ea7cbd48a4cddb7f8f3290d22678c)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:32.117627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f449b-e11b-4c53-acbf-0a05b9223225 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:32.120380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 87/181] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:31 2022] GET /identity/v3/projects/0f2ea7cbd48a4cddb7f8f3290d22678c => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:32.122165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb9dfd-d118-4181-8380-b33a846104f4 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.122453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb9dfd-d118-4181-8380-b33a846104f4 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.122733 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb9dfd-d118-4181-8380-b33a846104f4 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.124760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 88/182] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:32.127932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab324-3f5c-4469-a8bd-15422e53abee None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.128489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab324-3f5c-4469-a8bd-15422e53abee None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.128988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ab324-3f5c-4469-a8bd-15422e53abee None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.130898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 89/183] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:32.131889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab324-3f5c-4469-a8bd-15422e53abee None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:32.156965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd32a-3c3c-4f78-a893-b63503021e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:32.158371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd32a-3c3c-4f78-a893-b63503021e35 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.158371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd32a-3c3c-4f78-a893-b63503021e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.158371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd32a-3c3c-4f78-a893-b63503021e35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.172861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dd32a-3c3c-4f78-a893-b63503021e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-171dd32a-3c3c-4f78-a893-b63503021e35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:32.177914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:32.178768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:32.179528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 95/184] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:32.180181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1cfd6-5a40-4e98-902f-a46eb1a221b3 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.180710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1cfd6-5a40-4e98-902f-a46eb1a221b3 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.180710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1cfd6-5a40-4e98-902f-a46eb1a221b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.198952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c7c1cfd6-5a40-4e98-902f-a46eb1a221b3 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:32.199895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c7c1cfd6-5a40-4e98-902f-a46eb1a221b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:32.262879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:32.268413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ab324-3f5c-4469-a8bd-15422e53abee None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:32.280345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 96/185] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:32.281703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1d2f-19e0-4334-8908-25ba6551cf49 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.281991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1d2f-19e0-4334-8908-25ba6551cf49 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.282262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1d2f-19e0-4334-8908-25ba6551cf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.305634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-419a1d2f-19e0-4334-8908-25ba6551cf49 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:32.306745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-419a1d2f-19e0-4334-8908-25ba6551cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:32.315085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98dffb-c5a4-42a4-821e-5c08e5f8fb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:32.316224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98dffb-c5a4-42a4-821e-5c08e5f8fb4c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.316680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98dffb-c5a4-42a4-821e-5c08e5f8fb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.317105 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98dffb-c5a4-42a4-821e-5c08e5f8fb4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.318018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98dffb-c5a4-42a4-821e-5c08e5f8fb4c None admin] RBAC: Adding query filter params (role.id=7c59786364c04f0087154923c39fa449, scope.project.id=0f2ea7cbd48a4cddb7f8f3290d22678c, user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:32.318476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98dffb-c5a4-42a4-821e-5c08e5f8fb4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:32.320068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98dffb-c5a4-42a4-821e-5c08e5f8fb4c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:32.333671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 90/186] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:32 2022] GET /identity/v3/role_assignments?user.id=2e5c72c28f2c4b5fbd6dab7c0388fba6&scope.project.id=0f2ea7cbd48a4cddb7f8f3290d22678c&role.id=7c59786364c04f0087154923c39fa449 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:32.334907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98dffb-c5a4-42a4-821e-5c08e5f8fb4c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:32.389407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 97/187] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:32.513732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096f057-b322-4a1b-931c-8c0c7c3f57b6 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.515045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096f057-b322-4a1b-931c-8c0c7c3f57b6 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.515550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096f057-b322-4a1b-931c-8c0c7c3f57b6 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.517687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 98/188] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:32.526845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa10d68-161a-427f-a82a-f4b5752514fb None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.527132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa10d68-161a-427f-a82a-f4b5752514fb None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.527396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa10d68-161a-427f-a82a-f4b5752514fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.528593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98dffb-c5a4-42a4-821e-5c08e5f8fb4c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:32.564515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-efa10d68-161a-427f-a82a-f4b5752514fb None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:32.566036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-efa10d68-161a-427f-a82a-f4b5752514fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:32.568988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:32.600574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011a2f9-2201-4037-b430-6719937bb513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:32.601203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011a2f9-2201-4037-b430-6719937bb513 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.601514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011a2f9-2201-4037-b430-6719937bb513 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.601799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011a2f9-2201-4037-b430-6719937bb513 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.602461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011a2f9-2201-4037-b430-6719937bb513 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:32.602770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011a2f9-2201-4037-b430-6719937bb513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:32.604169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011a2f9-2201-4037-b430-6719937bb513 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:32.617164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 91/189] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:32.618077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011a2f9-2201-4037-b430-6719937bb513 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:32.659692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:32.668649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 99/190] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:32.672428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa10d68-161a-427f-a82a-f4b5752514fb None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:32.767931 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011a2f9-2201-4037-b430-6719937bb513 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:32.797441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa10d68-161a-427f-a82a-f4b5752514fb None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:32.805911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656843c-01a8-464b-8d22-309123a9bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:32.806960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656843c-01a8-464b-8d22-309123a9bb59 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.806960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656843c-01a8-464b-8d22-309123a9bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.807166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656843c-01a8-464b-8d22-309123a9bb59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.808949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656843c-01a8-464b-8d22-309123a9bb59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:32.812803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656843c-01a8-464b-8d22-309123a9bb59 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:32.814773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 92/191] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:32.822214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656843c-01a8-464b-8d22-309123a9bb59 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:32.839554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea98c1-d5e7-456a-929e-e399d88cbd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:32.840052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea98c1-d5e7-456a-929e-e399d88cbd30 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.840333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea98c1-d5e7-456a-929e-e399d88cbd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.840605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea98c1-d5e7-456a-929e-e399d88cbd30 None admin] PATH_INFO: `/v3/users/fb7a2fa249f749f78b04125a85a4ef31` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.855544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:32.862676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea98c1-d5e7-456a-929e-e399d88cbd30 None admin] RBAC: Authorizing `identity:get_user(user_id=fb7a2fa249f749f78b04125a85a4ef31)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:32.864336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea98c1-d5e7-456a-929e-e399d88cbd30 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:32.867025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 100/192] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:32 2022] GET /identity/v3/users/fb7a2fa249f749f78b04125a85a4ef31 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:32.867625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea98c1-d5e7-456a-929e-e399d88cbd30 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:32.938371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:32.947750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656843c-01a8-464b-8d22-309123a9bb59 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:32.991726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4404-860f-49fa-9687-bfa48aad9e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:32.992383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4404-860f-49fa-9687-bfa48aad9e57 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:32.992656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4404-860f-49fa-9687-bfa48aad9e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:32.993088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4404-860f-49fa-9687-bfa48aad9e57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:32.995602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea98c1-d5e7-456a-929e-e399d88cbd30 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:33.004093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c4404-860f-49fa-9687-bfa48aad9e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ef7c4404-860f-49fa-9687-bfa48aad9e57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:33.008932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:33.009867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:33.010637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 93/193] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:11:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:33.011288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4404-860f-49fa-9687-bfa48aad9e57 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:33.036273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655fb6c-d4df-4ce1-885f-d3021600b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:33.036890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655fb6c-d4df-4ce1-885f-d3021600b5ef None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:33.037374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655fb6c-d4df-4ce1-885f-d3021600b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:33.037652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655fb6c-d4df-4ce1-885f-d3021600b5ef None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:33.038309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655fb6c-d4df-4ce1-885f-d3021600b5ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:33.039743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655fb6c-d4df-4ce1-885f-d3021600b5ef None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:33.077013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 101/194] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:11:32 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:33.077013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655fb6c-d4df-4ce1-885f-d3021600b5ef None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:33.138372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4404-860f-49fa-9687-bfa48aad9e57 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:33.151912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:33.193582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7ca86-bee8-4969-b8b5-cbf250c72e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:33.194224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7ca86-bee8-4969-b8b5-cbf250c72e29 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:33.194509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7ca86-bee8-4969-b8b5-cbf250c72e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:33.194781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7ca86-bee8-4969-b8b5-cbf250c72e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:33.222027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655fb6c-d4df-4ce1-885f-d3021600b5ef None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:33.228222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:33.269206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57f9a8-2444-455d-9e92-1951d5f16372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:33.269900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57f9a8-2444-455d-9e92-1951d5f16372 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:33.270185 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57f9a8-2444-455d-9e92-1951d5f16372 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:33.270474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57f9a8-2444-455d-9e92-1951d5f16372 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:33.284198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57f9a8-2444-455d-9e92-1951d5f16372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-5b57f9a8-2444-455d-9e92-1951d5f16372 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:33.289312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:33.290213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:33.290987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:33.291594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 102/195] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:33.292412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57f9a8-2444-455d-9e92-1951d5f16372 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:33.300790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7ca86-bee8-4969-b8b5-cbf250c72e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:33.302344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7ca86-bee8-4969-b8b5-cbf250c72e29 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:33.433352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57f9a8-2444-455d-9e92-1951d5f16372 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:33.447758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 94/196] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:33.448842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7ca86-bee8-4969-b8b5-cbf250c72e29 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:33.452355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:33.487602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f2682-2175-46bc-96f4-484695cee9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:33.488376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f2682-2175-46bc-96f4-484695cee9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:33.488593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f2682-2175-46bc-96f4-484695cee9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:33.488784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f2682-2175-46bc-96f4-484695cee9e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:33.489487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f2682-2175-46bc-96f4-484695cee9e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:33.490079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f2682-2175-46bc-96f4-484695cee9e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:33.491544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f2682-2175-46bc-96f4-484695cee9e2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:33.504479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 103/197] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:11:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:33.505595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f2682-2175-46bc-96f4-484695cee9e2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:33.535275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:33.602009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7ca86-bee8-4969-b8b5-cbf250c72e29 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:33.617335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f2682-2175-46bc-96f4-484695cee9e2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:33.652247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb4d93-2eed-44d7-8d81-6ada669e6f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:33.652874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb4d93-2eed-44d7-8d81-6ada669e6f47 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:33.653153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb4d93-2eed-44d7-8d81-6ada669e6f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:33.653472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb4d93-2eed-44d7-8d81-6ada669e6f47 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:33.654160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb4d93-2eed-44d7-8d81-6ada669e6f47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:33.654459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb4d93-2eed-44d7-8d81-6ada669e6f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:33.654561 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7a91-94b7-4126-98f6-30288ce48307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:33.655196 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7a91-94b7-4126-98f6-30288ce48307 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:33.655620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7a91-94b7-4126-98f6-30288ce48307 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:33.655969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7a91-94b7-4126-98f6-30288ce48307 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:33.656068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb4d93-2eed-44d7-8d81-6ada669e6f47 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:33.662575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef7a91-94b7-4126-98f6-30288ce48307 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:33.664149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef7a91-94b7-4126-98f6-30288ce48307 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:33.665358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 95/198] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:33.666217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb4d93-2eed-44d7-8d81-6ada669e6f47 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:33.666347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 104/199] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:33 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:33.676331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7a91-94b7-4126-98f6-30288ce48307 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:33.730070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:33.790886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7a91-94b7-4126-98f6-30288ce48307 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:33.820831 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb4d93-2eed-44d7-8d81-6ada669e6f47 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:33.844944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:33.851508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482464aa-03b5-4088-9461-f17641b6627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:33.852580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482464aa-03b5-4088-9461-f17641b6627f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:33.853282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482464aa-03b5-4088-9461-f17641b6627f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:33.853994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482464aa-03b5-4088-9461-f17641b6627f None admin] PATH_INFO: `/v3/users/fecdc974429144789e83b96710d24be9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:33.855941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482464aa-03b5-4088-9461-f17641b6627f None admin] RBAC: Authorizing `identity:get_user(user_id=fecdc974429144789e83b96710d24be9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:33.858115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482464aa-03b5-4088-9461-f17641b6627f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:33.860356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 105/200] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:33 2022] GET /identity/v3/users/fecdc974429144789e83b96710d24be9 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:33.861299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482464aa-03b5-4088-9461-f17641b6627f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:33.869327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6e46d-db95-4c8c-a2ce-2a1fa2f98ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:33.870206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6e46d-db95-4c8c-a2ce-2a1fa2f98ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:33.870670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6e46d-db95-4c8c-a2ce-2a1fa2f98ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:33.871635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6e46d-db95-4c8c-a2ce-2a1fa2f98ba7 None admin] PATH_INFO: `/v3/users/fb7a2fa249f749f78b04125a85a4ef31` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:33.872949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6e46d-db95-4c8c-a2ce-2a1fa2f98ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=fb7a2fa249f749f78b04125a85a4ef31)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:33.876114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6e46d-db95-4c8c-a2ce-2a1fa2f98ba7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:33.878473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 96/201] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:33 2022] GET /identity/v3/users/fb7a2fa249f749f78b04125a85a4ef31 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:33.879947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6e46d-db95-4c8c-a2ce-2a1fa2f98ba7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:33.970703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482464aa-03b5-4088-9461-f17641b6627f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:33.985115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:34.014965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83a7c7-6b15-4d0b-9aa9-d9a31a362074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:34.017179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83a7c7-6b15-4d0b-9aa9-d9a31a362074 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:34.018104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83a7c7-6b15-4d0b-9aa9-d9a31a362074 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:34.018556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83a7c7-6b15-4d0b-9aa9-d9a31a362074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:34.019732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83a7c7-6b15-4d0b-9aa9-d9a31a362074 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=a32f116145b24d39a2550f593e4529e5, user.id=fb7a2fa249f749f78b04125a85a4ef31) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:34.020194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83a7c7-6b15-4d0b-9aa9-d9a31a362074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:34.022101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83a7c7-6b15-4d0b-9aa9-d9a31a362074 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:34.024602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6e46d-db95-4c8c-a2ce-2a1fa2f98ba7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:34.029838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 106/202] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:33 2022] GET /identity/v3/role_assignments?user.id=fb7a2fa249f749f78b04125a85a4ef31&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:34.031406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83a7c7-6b15-4d0b-9aa9-d9a31a362074 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:34.063620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f60b0-ec9f-44b8-9611-90a39354b264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:34.064376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f60b0-ec9f-44b8-9611-90a39354b264 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:34.064753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f60b0-ec9f-44b8-9611-90a39354b264 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:34.065124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f60b0-ec9f-44b8-9611-90a39354b264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:34.138222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:34.163748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f60b0-ec9f-44b8-9611-90a39354b264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:34.165416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83a7c7-6b15-4d0b-9aa9-d9a31a362074 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:34.165690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f60b0-ec9f-44b8-9611-90a39354b264 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:34.222008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce283b-1c15-49e4-95ba-c53a2d59c2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:34.223109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce283b-1c15-49e4-95ba-c53a2d59c2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:34.223909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce283b-1c15-49e4-95ba-c53a2d59c2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:34.225083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce283b-1c15-49e4-95ba-c53a2d59c2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:34.320792 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:34.360243 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce283b-1c15-49e4-95ba-c53a2d59c2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:34.363133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce283b-1c15-49e4-95ba-c53a2d59c2f5 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:34.364437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 97/203] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:34.372042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f60b0-ec9f-44b8-9611-90a39354b264 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:34.536967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:34.566705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 107/204] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:34.573331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f60b0-ec9f-44b8-9611-90a39354b264 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:34.574289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce283b-1c15-49e4-95ba-c53a2d59c2f5 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:34.616937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3c29a-ce75-4cd0-b080-99b85d61d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:34.617637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3c29a-ce75-4cd0-b080-99b85d61d864 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:34.617916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3c29a-ce75-4cd0-b080-99b85d61d864 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:34.618190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3c29a-ce75-4cd0-b080-99b85d61d864 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:34.621992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3c29a-ce75-4cd0-b080-99b85d61d864 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:34.623481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3c29a-ce75-4cd0-b080-99b85d61d864 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:34.625318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 98/205] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:34 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:34.631163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3c29a-ce75-4cd0-b080-99b85d61d864 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:34.732626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:34.761112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3c29a-ce75-4cd0-b080-99b85d61d864 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:34.769079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce283b-1c15-49e4-95ba-c53a2d59c2f5 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:34.798178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e71a-7582-403d-a1a6-20e0b368b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:34.799181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e71a-7582-403d-a1a6-20e0b368b19b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:34.799678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e71a-7582-403d-a1a6-20e0b368b19b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:34.800196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e71a-7582-403d-a1a6-20e0b368b19b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:34.801114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e71a-7582-403d-a1a6-20e0b368b19b None admin] RBAC: Adding query filter params (role.id=8449438b350d420cb4d3a8450c21a891, scope.project.id=5039b090c00e4b52901878d5da90d9a4, user.id=fecdc974429144789e83b96710d24be9) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:34.801648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e71a-7582-403d-a1a6-20e0b368b19b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:34.803570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e71a-7582-403d-a1a6-20e0b368b19b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:34.810276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 99/206] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:34 2022] GET /identity/v3/role_assignments?user.id=fecdc974429144789e83b96710d24be9&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=8449438b350d420cb4d3a8450c21a891 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:34.860504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133725-b926-4d5a-8f75-d97a3563127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:34.861685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133725-b926-4d5a-8f75-d97a3563127d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:34.862190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133725-b926-4d5a-8f75-d97a3563127d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:34.862697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133725-b926-4d5a-8f75-d97a3563127d None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:34.866392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad133725-b926-4d5a-8f75-d97a3563127d None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:34.868855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad133725-b926-4d5a-8f75-d97a3563127d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:34.873406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 108/207] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:34 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:34.877824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e71a-7582-403d-a1a6-20e0b368b19b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:34.912464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:35.038575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e71a-7582-403d-a1a6-20e0b368b19b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:35.077158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338ba5d-959a-4b11-9445-86f9df2fcc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:35.077879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338ba5d-959a-4b11-9445-86f9df2fcc2b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:35.078167 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338ba5d-959a-4b11-9445-86f9df2fcc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:35.078437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338ba5d-959a-4b11-9445-86f9df2fcc2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:35.079174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338ba5d-959a-4b11-9445-86f9df2fcc2b None admin] RBAC: Adding query filter params (role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=a32f116145b24d39a2550f593e4529e5, user.id=fb7a2fa249f749f78b04125a85a4ef31) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:35.079480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338ba5d-959a-4b11-9445-86f9df2fcc2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:35.080932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338ba5d-959a-4b11-9445-86f9df2fcc2b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:35.086855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 100/208] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:34 2022] GET /identity/v3/role_assignments?user.id=fb7a2fa249f749f78b04125a85a4ef31&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:35.646461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532da5f-2af4-4829-9134-eafc9de6e662 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:35.646970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532da5f-2af4-4829-9134-eafc9de6e662 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:35.647073 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532da5f-2af4-4829-9134-eafc9de6e662 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:35.648512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 109/209] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:35.654221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51928ca2-5d66-4a94-9c27-620c172e98b4 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:35.655074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51928ca2-5d66-4a94-9c27-620c172e98b4 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:35.656103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51928ca2-5d66-4a94-9c27-620c172e98b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:35.679364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-51928ca2-5d66-4a94-9c27-620c172e98b4 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:35.680780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-51928ca2-5d66-4a94-9c27-620c172e98b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:35.755693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 101/210] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:35.868034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e539623-2cc3-46fa-9283-041fcb81641b None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:35.868492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e539623-2cc3-46fa-9283-041fcb81641b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:35.868872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e539623-2cc3-46fa-9283-041fcb81641b None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:35.870390 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 110/211] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:35.876195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db124e-013a-4733-8de8-e7effbfb29d0 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:35.876493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db124e-013a-4733-8de8-e7effbfb29d0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:35.876775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db124e-013a-4733-8de8-e7effbfb29d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:35.896588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e6db124e-013a-4733-8de8-e7effbfb29d0 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:35.897756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e6db124e-013a-4733-8de8-e7effbfb29d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:35.900935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:35.972999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 102/212] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:36.033993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e539623-2cc3-46fa-9283-041fcb81641b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:36.145842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e539623-2cc3-46fa-9283-041fcb81641b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:36.181509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947cdd4-9c32-4dfa-9f74-c189a003a4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:36.182155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947cdd4-9c32-4dfa-9f74-c189a003a4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:36.182435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947cdd4-9c32-4dfa-9f74-c189a003a4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:36.182707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947cdd4-9c32-4dfa-9f74-c189a003a4c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:36.183816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947cdd4-9c32-4dfa-9f74-c189a003a4c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:36.185295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947cdd4-9c32-4dfa-9f74-c189a003a4c4 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:36.187269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 111/213] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:36.198579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db124e-013a-4733-8de8-e7effbfb29d0 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:36.262508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947cdd4-9c32-4dfa-9f74-c189a003a4c4 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:36.284245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:36.310814 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db124e-013a-4733-8de8-e7effbfb29d0 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:36.358577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda8d0b-cdad-461c-b5ef-17278d6756e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:36.359368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda8d0b-cdad-461c-b5ef-17278d6756e1 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:36.359752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda8d0b-cdad-461c-b5ef-17278d6756e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:36.360148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda8d0b-cdad-461c-b5ef-17278d6756e1 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:36.360922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda8d0b-cdad-461c-b5ef-17278d6756e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:36.362629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda8d0b-cdad-461c-b5ef-17278d6756e1 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:36.375458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:36.393654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 103/214] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:11:36 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:11:36.395306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947cdd4-9c32-4dfa-9f74-c189a003a4c4 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:36.451274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d1d5c-fa6c-476c-9f87-952ff6a88781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:36.452369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d1d5c-fa6c-476c-9f87-952ff6a88781 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:36.452858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d1d5c-fa6c-476c-9f87-952ff6a88781 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:36.453419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d1d5c-fa6c-476c-9f87-952ff6a88781 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:36.466716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d1d5c-fa6c-476c-9f87-952ff6a88781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-337d1d5c-fa6c-476c-9f87-952ff6a88781 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:36.473063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:36.474049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:36.474821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:36.477274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 112/215] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:36.484554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda8d0b-cdad-461c-b5ef-17278d6756e1 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:36.539321 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8319-ec97-4626-bb4d-266b17e34a42 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:36.539655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8319-ec97-4626-bb4d-266b17e34a42 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:36.539883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8319-ec97-4626-bb4d-266b17e34a42 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:36.542079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 113/216] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:36.547629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbf2b2-ed2a-4594-bc7b-a984ba0faabf None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:36.547923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbf2b2-ed2a-4594-bc7b-a984ba0faabf None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:36.548176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbf2b2-ed2a-4594-bc7b-a984ba0faabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:36.571138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-54dbf2b2-ed2a-4594-bc7b-a984ba0faabf None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:36.572394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-54dbf2b2-ed2a-4594-bc7b-a984ba0faabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:36.613182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda8d0b-cdad-461c-b5ef-17278d6756e1 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:36.656066 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e8e0f-5120-412e-917c-baa0a522e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:36.656691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e8e0f-5120-412e-917c-baa0a522e17d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:36.656981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e8e0f-5120-412e-917c-baa0a522e17d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:36.657335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e8e0f-5120-412e-917c-baa0a522e17d None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:36.664639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e8e0f-5120-412e-917c-baa0a522e17d None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:36.664639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e8e0f-5120-412e-917c-baa0a522e17d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:36.664877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 114/217] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:36.665276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e8e0f-5120-412e-917c-baa0a522e17d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:36.673316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 104/218] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:36.679136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbf2b2-ed2a-4594-bc7b-a984ba0faabf None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:36.681613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:36.788917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbf2b2-ed2a-4594-bc7b-a984ba0faabf None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:36.832356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad4dc-8add-4e81-889f-09da2c1add41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:36.833039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad4dc-8add-4e81-889f-09da2c1add41 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:36.833348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad4dc-8add-4e81-889f-09da2c1add41 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:36.833627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad4dc-8add-4e81-889f-09da2c1add41 None admin] PATH_INFO: `/v3/users/109cf9b0b9324a99bcfc0a906cb9f061` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:36.850904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dad4dc-8add-4e81-889f-09da2c1add41 None admin] RBAC: Authorizing `identity:get_user(user_id=109cf9b0b9324a99bcfc0a906cb9f061)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:36.852757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dad4dc-8add-4e81-889f-09da2c1add41 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:36.855097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 115/219] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:36 2022] GET /identity/v3/users/109cf9b0b9324a99bcfc0a906cb9f061 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:36.861423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e8e0f-5120-412e-917c-baa0a522e17d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:36.934052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:36.949095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad4dc-8add-4e81-889f-09da2c1add41 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:36.989988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e8e0f-5120-412e-917c-baa0a522e17d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:37.038109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:37.065725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e670d90-8613-40f4-9bbf-efd653f1173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:37.066706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670d90-8613-40f4-9bbf-efd653f1173d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:37.067200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670d90-8613-40f4-9bbf-efd653f1173d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:37.067689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670d90-8613-40f4-9bbf-efd653f1173d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:37.145267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad4dc-8add-4e81-889f-09da2c1add41 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:37.206664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8a49a-a157-4035-921a-5fdb449f965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:37.207336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8a49a-a157-4035-921a-5fdb449f965e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:37.207619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8a49a-a157-4035-921a-5fdb449f965e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:37.207892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8a49a-a157-4035-921a-5fdb449f965e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:37.234501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8a49a-a157-4035-921a-5fdb449f965e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-11c8a49a-a157-4035-921a-5fdb449f965e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:37.240378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:37.241358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:37.242138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:37.246037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 116/220] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:11:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:37.247573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670d90-8613-40f4-9bbf-efd653f1173d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:37.249941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670d90-8613-40f4-9bbf-efd653f1173d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:37.253403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8a49a-a157-4035-921a-5fdb449f965e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:37.335292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:37.409649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 105/221] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:37.410967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e3cbf-dc90-4b43-9685-301838a9fb0a None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:37.411254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e3cbf-dc90-4b43-9685-301838a9fb0a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:37.411527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e3cbf-dc90-4b43-9685-301838a9fb0a None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:37.413170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 106/222] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:37.415552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e3cbf-dc90-4b43-9685-301838a9fb0a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:37.446912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8a49a-a157-4035-921a-5fdb449f965e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:37.477727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:37.497780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f1937-b75a-4270-84b1-89c305f61e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:37.498843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1937-b75a-4270-84b1-89c305f61e0e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:37.500220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1937-b75a-4270-84b1-89c305f61e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:37.500678 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1937-b75a-4270-84b1-89c305f61e0e None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:37.501564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f1937-b75a-4270-84b1-89c305f61e0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:37.502026 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f1937-b75a-4270-84b1-89c305f61e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:37.503668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f1937-b75a-4270-84b1-89c305f61e0e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:37.516717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 117/223] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:37.518621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed04548-d561-4fb3-b8be-3679520c6aa3 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:37.519065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed04548-d561-4fb3-b8be-3679520c6aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:37.519490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed04548-d561-4fb3-b8be-3679520c6aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:37.536643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e3cbf-dc90-4b43-9685-301838a9fb0a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:37.543950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-2ed04548-d561-4fb3-b8be-3679520c6aa3 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:37.545786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2ed04548-d561-4fb3-b8be-3679520c6aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:37.586284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f12ee-5b5b-4dbd-a86f-42067ef47a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:37.587403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f12ee-5b5b-4dbd-a86f-42067ef47a67 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:37.587963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f12ee-5b5b-4dbd-a86f-42067ef47a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:37.588511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f12ee-5b5b-4dbd-a86f-42067ef47a67 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:37.589883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f12ee-5b5b-4dbd-a86f-42067ef47a67 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:37.592868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f12ee-5b5b-4dbd-a86f-42067ef47a67 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:37.594846 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 107/224] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:37 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:37.595804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f12ee-5b5b-4dbd-a86f-42067ef47a67 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:37.631306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:37.644505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 118/225] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:37.645576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed04548-d561-4fb3-b8be-3679520c6aa3 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:37.752524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f12ee-5b5b-4dbd-a86f-42067ef47a67 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:37.824939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ab276-3880-43e8-afbf-48287c652559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:37.825627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ab276-3880-43e8-afbf-48287c652559 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:37.825907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ab276-3880-43e8-afbf-48287c652559 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:37.826182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ab276-3880-43e8-afbf-48287c652559 None admin] PATH_INFO: `/v3/users/fb7a2fa249f749f78b04125a85a4ef31` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:37.828103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ab276-3880-43e8-afbf-48287c652559 None admin] RBAC: Authorizing `identity:get_user(user_id=fb7a2fa249f749f78b04125a85a4ef31)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:37.829583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ab276-3880-43e8-afbf-48287c652559 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:37.833668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 108/226] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:37 2022] GET /identity/v3/users/fb7a2fa249f749f78b04125a85a4ef31 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:37.843398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ab276-3880-43e8-afbf-48287c652559 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:37.847332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed04548-d561-4fb3-b8be-3679520c6aa3 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:37.862649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:37.889677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36718797-89c5-4a55-a81d-25f1de6bd4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:37.893389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36718797-89c5-4a55-a81d-25f1de6bd4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:37.893887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36718797-89c5-4a55-a81d-25f1de6bd4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:37.894360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36718797-89c5-4a55-a81d-25f1de6bd4d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:37.895279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36718797-89c5-4a55-a81d-25f1de6bd4d3 None admin] RBAC: Adding query filter params (role.id=7c59786364c04f0087154923c39fa449, scope.project.id=a32f116145b24d39a2550f593e4529e5, user.id=109cf9b0b9324a99bcfc0a906cb9f061) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:37.895986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36718797-89c5-4a55-a81d-25f1de6bd4d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:37.898586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36718797-89c5-4a55-a81d-25f1de6bd4d3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:37.916488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 119/227] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:37 2022] GET /identity/v3/role_assignments?user.id=109cf9b0b9324a99bcfc0a906cb9f061&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=7c59786364c04f0087154923c39fa449 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:37.985136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36718797-89c5-4a55-a81d-25f1de6bd4d3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:38.028058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:38.042110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ab276-3880-43e8-afbf-48287c652559 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:38.108414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca297057-d17d-4ad0-a96a-afb9548dc146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:38.109558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca297057-d17d-4ad0-a96a-afb9548dc146 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:38.109837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca297057-d17d-4ad0-a96a-afb9548dc146 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:38.110109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca297057-d17d-4ad0-a96a-afb9548dc146 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:38.111344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca297057-d17d-4ad0-a96a-afb9548dc146 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:38.112785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca297057-d17d-4ad0-a96a-afb9548dc146 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:38.114777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 109/228] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:37 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:38.122748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca297057-d17d-4ad0-a96a-afb9548dc146 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:38.151834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36718797-89c5-4a55-a81d-25f1de6bd4d3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:38.191221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77692b3-b6b5-4ba4-b2fa-8a7b7d53d449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:38.192039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77692b3-b6b5-4ba4-b2fa-8a7b7d53d449 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:38.192419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77692b3-b6b5-4ba4-b2fa-8a7b7d53d449 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:38.192869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77692b3-b6b5-4ba4-b2fa-8a7b7d53d449 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:38.205469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77692b3-b6b5-4ba4-b2fa-8a7b7d53d449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-a77692b3-b6b5-4ba4-b2fa-8a7b7d53d449 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:38.211705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:38.212733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:38.213651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 120/229] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:11:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:38.222724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77692b3-b6b5-4ba4-b2fa-8a7b7d53d449 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:38.291186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca297057-d17d-4ad0-a96a-afb9548dc146 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:38.303114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:38.378726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77692b3-b6b5-4ba4-b2fa-8a7b7d53d449 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:38.390442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65244b48-eaa4-497c-8d3c-8a9e03d9ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:38.391391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65244b48-eaa4-497c-8d3c-8a9e03d9ad2d None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:38.391872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65244b48-eaa4-497c-8d3c-8a9e03d9ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:38.392342 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65244b48-eaa4-497c-8d3c-8a9e03d9ad2d None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5/users/fb7a2fa249f749f78b04125a85a4ef31/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:38.398480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65244b48-eaa4-497c-8d3c-8a9e03d9ad2d None admin] RBAC: Authorizing `identity:create_grant(project_id=a32f116145b24d39a2550f593e4529e5, user_id=fb7a2fa249f749f78b04125a85a4ef31, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:38.400148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65244b48-eaa4-497c-8d3c-8a9e03d9ad2d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:38.417797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738b26-e327-44f6-adf1-61bb210f64c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:38.418434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738b26-e327-44f6-adf1-61bb210f64c4 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:38.418719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738b26-e327-44f6-adf1-61bb210f64c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:38.418997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2738b26-e327-44f6-adf1-61bb210f64c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:38.419786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738b26-e327-44f6-adf1-61bb210f64c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:38.420096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738b26-e327-44f6-adf1-61bb210f64c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:38.421630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2738b26-e327-44f6-adf1-61bb210f64c4 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:38.428272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 110/230] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:11:38 2022] PUT /identity/v3/projects/a32f116145b24d39a2550f593e4529e5/users/fb7a2fa249f749f78b04125a85a4ef31/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:11:38.431312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 121/231] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:11:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:38.437176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65244b48-eaa4-497c-8d3c-8a9e03d9ad2d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:38.473971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:38.591471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65244b48-eaa4-497c-8d3c-8a9e03d9ad2d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:38.642882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a52af-f349-433d-9b22-b3d9fe41148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:38.643929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a52af-f349-433d-9b22-b3d9fe41148c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:38.644409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a52af-f349-433d-9b22-b3d9fe41148c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:38.644884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a52af-f349-433d-9b22-b3d9fe41148c None admin] PATH_INFO: `/v3/users/fb7a2fa249f749f78b04125a85a4ef31` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:38.650157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a52af-f349-433d-9b22-b3d9fe41148c None admin] RBAC: Authorizing `identity:get_user(user_id=fb7a2fa249f749f78b04125a85a4ef31)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:38.651949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a52af-f349-433d-9b22-b3d9fe41148c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:38.654009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 111/232] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:38 2022] GET /identity/v3/users/fb7a2fa249f749f78b04125a85a4ef31 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:38.659987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738b26-e327-44f6-adf1-61bb210f64c4 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:38.801934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:38.805837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2738b26-e327-44f6-adf1-61bb210f64c4 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:38.842411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28212b-98e4-47fc-a701-47c5a42b3557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:38.843105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28212b-98e4-47fc-a701-47c5a42b3557 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:38.843385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28212b-98e4-47fc-a701-47c5a42b3557 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:38.843654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28212b-98e4-47fc-a701-47c5a42b3557 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:38.844798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28212b-98e4-47fc-a701-47c5a42b3557 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:38.846333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28212b-98e4-47fc-a701-47c5a42b3557 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:38.848479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 122/233] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:38 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:38.854299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a52af-f349-433d-9b22-b3d9fe41148c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:38.958053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:38.969393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a52af-f349-433d-9b22-b3d9fe41148c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:39.017265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7bdcb-0710-4fee-b3fe-bce23489a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:39.017945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7bdcb-0710-4fee-b3fe-bce23489a934 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:39.018221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7bdcb-0710-4fee-b3fe-bce23489a934 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:39.018494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7bdcb-0710-4fee-b3fe-bce23489a934 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5/users/fb7a2fa249f749f78b04125a85a4ef31/roles/3ba0b7b6bdc646f586a35aafc5c739f2` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:39.020652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7bdcb-0710-4fee-b3fe-bce23489a934 None admin] RBAC: Authorizing `identity:create_grant(project_id=a32f116145b24d39a2550f593e4529e5, user_id=fb7a2fa249f749f78b04125a85a4ef31, role_id=3ba0b7b6bdc646f586a35aafc5c739f2)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:39.022110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7bdcb-0710-4fee-b3fe-bce23489a934 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:39.041783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 112/234] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:11:38 2022] PUT /identity/v3/projects/a32f116145b24d39a2550f593e4529e5/users/fb7a2fa249f749f78b04125a85a4ef31/roles/3ba0b7b6bdc646f586a35aafc5c739f2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:11:39.339311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22fede-f7cf-4205-a47e-ea2ec1ce5b7e None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:39.340007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22fede-f7cf-4205-a47e-ea2ec1ce5b7e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:39.340488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22fede-f7cf-4205-a47e-ea2ec1ce5b7e None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:39.342369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 123/235] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:39.344792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934b9f9-b351-4a2b-ab82-7af899bd620b None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:39.345305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934b9f9-b351-4a2b-ab82-7af899bd620b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:39.345791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934b9f9-b351-4a2b-ab82-7af899bd620b None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:39.348029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59179c8-9c2d-4ee8-90fd-41f304c6432d None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:39.348519 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59179c8-9c2d-4ee8-90fd-41f304c6432d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:39.348982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59179c8-9c2d-4ee8-90fd-41f304c6432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:39.349406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 113/236] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:39.354774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c637d-e216-4b90-9496-0fa4dfe18220 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:39.355895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c637d-e216-4b90-9496-0fa4dfe18220 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:39.355895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c637d-e216-4b90-9496-0fa4dfe18220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:39.377610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-c54c637d-e216-4b90-9496-0fa4dfe18220 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:39.379135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c54c637d-e216-4b90-9496-0fa4dfe18220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:39.382624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f59179c8-9c2d-4ee8-90fd-41f304c6432d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:39.383870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f59179c8-9c2d-4ee8-90fd-41f304c6432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:39.494149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 114/237] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:39.501258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 124/238] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:39.777515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c637d-e216-4b90-9496-0fa4dfe18220 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:39.902992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:39.926113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c637d-e216-4b90-9496-0fa4dfe18220 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:39.981171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68fa10-53af-4e9c-a0c5-52aa09332f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:39.981879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fa10-53af-4e9c-a0c5-52aa09332f17 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:39.982164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fa10-53af-4e9c-a0c5-52aa09332f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:39.982437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fa10-53af-4e9c-a0c5-52aa09332f17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:40.000683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68fa10-53af-4e9c-a0c5-52aa09332f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:40.000872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59179c8-9c2d-4ee8-90fd-41f304c6432d None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-9a68fa10-53af-4e9c-a0c5-52aa09332f17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:40.010671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:40.011611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:40.012656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 115/239] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:40.021964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68fa10-53af-4e9c-a0c5-52aa09332f17 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:40.127803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:40.136245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59179c8-9c2d-4ee8-90fd-41f304c6432d None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:40.173068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe95a4d-66d1-4e02-953d-ac596d9f1925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:40.174162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95a4d-66d1-4e02-953d-ac596d9f1925 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:40.174643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95a4d-66d1-4e02-953d-ac596d9f1925 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:40.175116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95a4d-66d1-4e02-953d-ac596d9f1925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:40.176485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe95a4d-66d1-4e02-953d-ac596d9f1925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:40.178988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe95a4d-66d1-4e02-953d-ac596d9f1925 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:40.180928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 125/240] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:40.190261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe95a4d-66d1-4e02-953d-ac596d9f1925 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:40.204271 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68fa10-53af-4e9c-a0c5-52aa09332f17 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:40.240916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859fa38-e0a2-4496-8e2a-bdf7d4a1cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:40.241574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859fa38-e0a2-4496-8e2a-bdf7d4a1cf78 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:40.241850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859fa38-e0a2-4496-8e2a-bdf7d4a1cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:40.242121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859fa38-e0a2-4496-8e2a-bdf7d4a1cf78 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:40.243017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859fa38-e0a2-4496-8e2a-bdf7d4a1cf78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:40.243123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859fa38-e0a2-4496-8e2a-bdf7d4a1cf78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:40.253162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859fa38-e0a2-4496-8e2a-bdf7d4a1cf78 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:40.253357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 116/241] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:40.259517 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859fa38-e0a2-4496-8e2a-bdf7d4a1cf78 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:40.263216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:40.420319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe95a4d-66d1-4e02-953d-ac596d9f1925 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:40.457192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b527765-ebca-487c-96ee-c3a90577fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:40.457968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b527765-ebca-487c-96ee-c3a90577fd8d None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:40.458258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b527765-ebca-487c-96ee-c3a90577fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:40.458525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b527765-ebca-487c-96ee-c3a90577fd8d None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:40.459430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b527765-ebca-487c-96ee-c3a90577fd8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:40.460876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b527765-ebca-487c-96ee-c3a90577fd8d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:40.487837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 126/242] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:11:40 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:40.499480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859fa38-e0a2-4496-8e2a-bdf7d4a1cf78 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:40.591578 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ae5ec-b166-4276-bd29-a8f8a94d79d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:40.592250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ae5ec-b166-4276-bd29-a8f8a94d79d9 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:40.592535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ae5ec-b166-4276-bd29-a8f8a94d79d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:40.592873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ae5ec-b166-4276-bd29-a8f8a94d79d9 None admin] PATH_INFO: `/v3/users/92a982a495ac44688acfa81d10b4cec3` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:40.605139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8ab13-92d7-494e-a251-48ed2ff81c13 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:40.605460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8ab13-92d7-494e-a251-48ed2ff81c13 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:40.605716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8ab13-92d7-494e-a251-48ed2ff81c13 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:40.608175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 127/243] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:40.613323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eccc6f-5a2b-4759-a090-85e2ac53a01a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:40.613613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eccc6f-5a2b-4759-a090-85e2ac53a01a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:40.613891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eccc6f-5a2b-4759-a090-85e2ac53a01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:40.617560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ae5ec-b166-4276-bd29-a8f8a94d79d9 None admin] RBAC: Authorizing `identity:get_user(user_id=92a982a495ac44688acfa81d10b4cec3)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:40.619069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ae5ec-b166-4276-bd29-a8f8a94d79d9 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:40.623250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 117/244] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:40 2022] GET /identity/v3/users/92a982a495ac44688acfa81d10b4cec3 => generated 297 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:40.634367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ae5ec-b166-4276-bd29-a8f8a94d79d9 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:40.643944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-72eccc6f-5a2b-4759-a090-85e2ac53a01a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:40.645293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-72eccc6f-5a2b-4759-a090-85e2ac53a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:40.689627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:40.747910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 128/245] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:40.771384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:40.813231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ae5ec-b166-4276-bd29-a8f8a94d79d9 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:40.851824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1f881-bc46-46cc-bd37-b2f9c884e29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:40.852440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1f881-bc46-46cc-bd37-b2f9c884e29e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:40.852715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1f881-bc46-46cc-bd37-b2f9c884e29e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:40.852982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1f881-bc46-46cc-bd37-b2f9c884e29e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:40.924756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1f881-bc46-46cc-bd37-b2f9c884e29e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:40.926258 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1f881-bc46-46cc-bd37-b2f9c884e29e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:40.987857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:41.037460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 118/246] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:41.039145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eccc6f-5a2b-4759-a090-85e2ac53a01a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:41.061349 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1f881-bc46-46cc-bd37-b2f9c884e29e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:41.172280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eccc6f-5a2b-4759-a090-85e2ac53a01a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:41.197886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1f881-bc46-46cc-bd37-b2f9c884e29e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:41.212858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac560c-863d-42ca-9d82-5acced72010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:41.213717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac560c-863d-42ca-9d82-5acced72010e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.214238 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac560c-863d-42ca-9d82-5acced72010e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.214711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac560c-863d-42ca-9d82-5acced72010e None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:41.216152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac560c-863d-42ca-9d82-5acced72010e None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:41.218002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac560c-863d-42ca-9d82-5acced72010e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:41.221796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 129/247] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:41 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:41.232531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac560c-863d-42ca-9d82-5acced72010e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:41.244896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ddae5-d3f3-4e3c-a40e-25c74e72649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:41.245648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ddae5-d3f3-4e3c-a40e-25c74e72649a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.245935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ddae5-d3f3-4e3c-a40e-25c74e72649a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.246205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ddae5-d3f3-4e3c-a40e-25c74e72649a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:41.258403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ddae5-d3f3-4e3c-a40e-25c74e72649a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-037ddae5-d3f3-4e3c-a40e-25c74e72649a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:41.263292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:41.265626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:41.266507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 119/248] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:41.271240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ddae5-d3f3-4e3c-a40e-25c74e72649a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:41.275157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:41.298355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:41.399101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ddae5-d3f3-4e3c-a40e-25c74e72649a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:41.414760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac560c-863d-42ca-9d82-5acced72010e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:41.438963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46246-ca9e-4d73-9e05-9231c4efca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:41.439617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46246-ca9e-4d73-9e05-9231c4efca31 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.439894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46246-ca9e-4d73-9e05-9231c4efca31 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.440165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46246-ca9e-4d73-9e05-9231c4efca31 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:41.440879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46246-ca9e-4d73-9e05-9231c4efca31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:41.441258 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46246-ca9e-4d73-9e05-9231c4efca31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:41.442662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46246-ca9e-4d73-9e05-9231c4efca31 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:41.451691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 120/249] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:41.458717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46246-ca9e-4d73-9e05-9231c4efca31 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:41.466677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a0728-6446-4166-a8de-5e8911426626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:41.467746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0728-6446-4166-a8de-5e8911426626 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.468755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0728-6446-4166-a8de-5e8911426626 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.469287 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0728-6446-4166-a8de-5e8911426626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:41.470367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a0728-6446-4166-a8de-5e8911426626 None admin] RBAC: Adding query filter params (role.id=8449438b350d420cb4d3a8450c21a891, scope.project.id=a32f116145b24d39a2550f593e4529e5, user.id=92a982a495ac44688acfa81d10b4cec3) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:41.470907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a0728-6446-4166-a8de-5e8911426626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:41.472601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a0728-6446-4166-a8de-5e8911426626 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:41.485861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 130/250] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:41 2022] GET /identity/v3/role_assignments?user.id=92a982a495ac44688acfa81d10b4cec3&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=8449438b350d420cb4d3a8450c21a891 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:41.562761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:41.567354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41971ef-5179-43e8-8fbf-1147b5ada6df None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.567705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41971ef-5179-43e8-8fbf-1147b5ada6df None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.567968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41971ef-5179-43e8-8fbf-1147b5ada6df None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:41.569497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 131/251] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:41.584419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032f39e-a33e-49b4-a5b0-933e7ae9b3fc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.584762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032f39e-a33e-49b4-a5b0-933e7ae9b3fc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.585090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032f39e-a33e-49b4-a5b0-933e7ae9b3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:41.607094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46246-ca9e-4d73-9e05-9231c4efca31 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:41.625420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6032f39e-a33e-49b4-a5b0-933e7ae9b3fc None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:41.626725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6032f39e-a33e-49b4-a5b0-933e7ae9b3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:41.693123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1a5ca-39dc-4632-b830-d1853f99e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:41.694282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1a5ca-39dc-4632-b830-d1853f99e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.694778 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1a5ca-39dc-4632-b830-d1853f99e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.695374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1a5ca-39dc-4632-b830-d1853f99e3a4 None admin] PATH_INFO: `/v3/users/109cf9b0b9324a99bcfc0a906cb9f061` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:41.699288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1a5ca-39dc-4632-b830-d1853f99e3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=109cf9b0b9324a99bcfc0a906cb9f061)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:41.701163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1a5ca-39dc-4632-b830-d1853f99e3a4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:41.703811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 121/252] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:41 2022] GET /identity/v3/users/109cf9b0b9324a99bcfc0a906cb9f061 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:41.710226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1a5ca-39dc-4632-b830-d1853f99e3a4 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:41.776385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 132/253] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:41.832003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1a5ca-39dc-4632-b830-d1853f99e3a4 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:41.871184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cd4fb-3623-4e38-92e8-b316bb6d1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:41.871829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cd4fb-3623-4e38-92e8-b316bb6d1d7c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.872107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cd4fb-3623-4e38-92e8-b316bb6d1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.872366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cd4fb-3623-4e38-92e8-b316bb6d1d7c None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:41.873687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cd4fb-3623-4e38-92e8-b316bb6d1d7c None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:41.875196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cd4fb-3623-4e38-92e8-b316bb6d1d7c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:41.876963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 122/254] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:41 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:41.883303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032f39e-a33e-49b4-a5b0-933e7ae9b3fc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:41.903420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:41.957982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c02ba-e18f-43cd-b308-1e54a16fa859 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.958499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c02ba-e18f-43cd-b308-1e54a16fa859 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.958964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c02ba-e18f-43cd-b308-1e54a16fa859 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:41.962039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 123/255] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:41.969037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8acc-5c2b-4be8-a7d9-53f096f4e6aa None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:41.969578 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8acc-5c2b-4be8-a7d9-53f096f4e6aa None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:41.970061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8acc-5c2b-4be8-a7d9-53f096f4e6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:42.033153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-bbba8acc-5c2b-4be8-a7d9-53f096f4e6aa None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:42.037099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-bbba8acc-5c2b-4be8-a7d9-53f096f4e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:42.068495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:42.090223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032f39e-a33e-49b4-a5b0-933e7ae9b3fc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:42.166897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab784b-07b2-4a51-bb6e-c9a4856b8f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:42.167992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab784b-07b2-4a51-bb6e-c9a4856b8f92 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:42.168490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab784b-07b2-4a51-bb6e-c9a4856b8f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:42.168961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab784b-07b2-4a51-bb6e-c9a4856b8f92 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5/users/109cf9b0b9324a99bcfc0a906cb9f061/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:42.171719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab784b-07b2-4a51-bb6e-c9a4856b8f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=a32f116145b24d39a2550f593e4529e5, user_id=109cf9b0b9324a99bcfc0a906cb9f061, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:42.177569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab784b-07b2-4a51-bb6e-c9a4856b8f92 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:42.197396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 133/256] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:11:41 2022] PUT /identity/v3/projects/a32f116145b24d39a2550f593e4529e5/users/109cf9b0b9324a99bcfc0a906cb9f061/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:11:42.242916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 124/257] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:42.248744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab784b-07b2-4a51-bb6e-c9a4856b8f92 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:42.382610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:42.432384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab784b-07b2-4a51-bb6e-c9a4856b8f92 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:42.480710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837b9c3-d600-464d-bbb2-3f5da3f3f98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:42.481776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837b9c3-d600-464d-bbb2-3f5da3f3f98c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:42.482259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837b9c3-d600-464d-bbb2-3f5da3f3f98c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:42.482728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837b9c3-d600-464d-bbb2-3f5da3f3f98c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:42.499630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837b9c3-d600-464d-bbb2-3f5da3f3f98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-3837b9c3-d600-464d-bbb2-3f5da3f3f98c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:42.504953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:42.505867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:42.506654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:42.509340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 134/258] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:42.515085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8acc-5c2b-4be8-a7d9-53f096f4e6aa None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:42.665747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837b9c3-d600-464d-bbb2-3f5da3f3f98c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:42.705368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8acc-5c2b-4be8-a7d9-53f096f4e6aa None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:42.778997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e755f1-b4aa-4e30-b126-990c44d44378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:42.779641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e755f1-b4aa-4e30-b126-990c44d44378 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:42.779924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e755f1-b4aa-4e30-b126-990c44d44378 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:42.780201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e755f1-b4aa-4e30-b126-990c44d44378 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:42.781473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e755f1-b4aa-4e30-b126-990c44d44378 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:42.781784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e755f1-b4aa-4e30-b126-990c44d44378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:42.783238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e755f1-b4aa-4e30-b126-990c44d44378 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:42.800486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 125/259] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:42.812404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e755f1-b4aa-4e30-b126-990c44d44378 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:42.835916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:42.909773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837b9c3-d600-464d-bbb2-3f5da3f3f98c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:42.983725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:42.998856 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ed1a-9783-4b53-9647-91e04b2ec78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:43.000061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ed1a-9783-4b53-9647-91e04b2ec78a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:43.000341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ed1a-9783-4b53-9647-91e04b2ec78a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:43.000610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0ed1a-9783-4b53-9647-91e04b2ec78a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:43.034339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0ed1a-9783-4b53-9647-91e04b2ec78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-0be0ed1a-9783-4b53-9647-91e04b2ec78a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:43.039423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:43.040418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:43.041188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 135/260] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:11:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:43.046462 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e755f1-b4aa-4e30-b126-990c44d44378 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:43.053693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ed1a-9783-4b53-9647-91e04b2ec78a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:43.133323 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a1eec-438e-4945-a908-db421002258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:43.133990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a1eec-438e-4945-a908-db421002258a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:43.134270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a1eec-438e-4945-a908-db421002258a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:43.134545 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a1eec-438e-4945-a908-db421002258a None admin] PATH_INFO: `/v3/users/fb7a2fa249f749f78b04125a85a4ef31` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:43.138051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a1eec-438e-4945-a908-db421002258a None admin] RBAC: Authorizing `identity:get_user(user_id=fb7a2fa249f749f78b04125a85a4ef31)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:43.139707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a1eec-438e-4945-a908-db421002258a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:43.141977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 126/261] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:42 2022] GET /identity/v3/users/fb7a2fa249f749f78b04125a85a4ef31 => generated 283 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:43.150998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a1eec-438e-4945-a908-db421002258a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:43.312524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:43.337794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a1eec-438e-4945-a908-db421002258a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:43.347262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0ed1a-9783-4b53-9647-91e04b2ec78a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:43.387920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e0b4f-ab51-4ea5-bc3b-05033b30c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:43.388893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e0b4f-ab51-4ea5-bc3b-05033b30c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:43.389434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e0b4f-ab51-4ea5-bc3b-05033b30c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:43.390435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e0b4f-ab51-4ea5-bc3b-05033b30c7e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:43.485974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de59bc-f2c1-4a4d-b9a5-3acba172a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:43.486625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de59bc-f2c1-4a4d-b9a5-3acba172a5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:43.486911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de59bc-f2c1-4a4d-b9a5-3acba172a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:43.487253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de59bc-f2c1-4a4d-b9a5-3acba172a5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:43.487934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de59bc-f2c1-4a4d-b9a5-3acba172a5a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:43.488247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de59bc-f2c1-4a4d-b9a5-3acba172a5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:43.489665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de59bc-f2c1-4a4d-b9a5-3acba172a5a6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:43.510517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 136/262] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:11:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:43.514247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e0b4f-ab51-4ea5-bc3b-05033b30c7e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:43.516488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e0b4f-ab51-4ea5-bc3b-05033b30c7e9 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:43.518239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de59bc-f2c1-4a4d-b9a5-3acba172a5a6 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:43.621096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:43.655871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:43.683707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 127/263] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:43.694301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e0b4f-ab51-4ea5-bc3b-05033b30c7e9 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:43.704713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de59bc-f2c1-4a4d-b9a5-3acba172a5a6 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:43.786031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341c87-0d55-4db3-90f9-0d289919e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:43.786713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341c87-0d55-4db3-90f9-0d289919e248 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:43.786996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341c87-0d55-4db3-90f9-0d289919e248 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:43.787268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2341c87-0d55-4db3-90f9-0d289919e248 None admin] PATH_INFO: `/v3/users/fb7a2fa249f749f78b04125a85a4ef31` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:43.788481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2341c87-0d55-4db3-90f9-0d289919e248 None admin] RBAC: Authorizing `identity:get_user(user_id=fb7a2fa249f749f78b04125a85a4ef31)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:43.790164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2341c87-0d55-4db3-90f9-0d289919e248 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:43.792400 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 137/264] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:43 2022] GET /identity/v3/users/fb7a2fa249f749f78b04125a85a4ef31 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:43.814348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341c87-0d55-4db3-90f9-0d289919e248 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:43.840682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e0b4f-ab51-4ea5-bc3b-05033b30c7e9 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:43.914060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a993-fa85-4093-a339-ff54d0157e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:43.914957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a993-fa85-4093-a339-ff54d0157e62 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:43.915388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a993-fa85-4093-a339-ff54d0157e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:43.915953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a993-fa85-4093-a339-ff54d0157e62 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:43.917799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266a993-fa85-4093-a339-ff54d0157e62 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:43.919453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266a993-fa85-4093-a339-ff54d0157e62 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:43.926137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 128/265] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:43 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:43.932287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a993-fa85-4093-a339-ff54d0157e62 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:44.013937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:44.026380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2341c87-0d55-4db3-90f9-0d289919e248 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:44.089624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:44.099188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a993-fa85-4093-a339-ff54d0157e62 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:44.122706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780c3cc-a25c-4edf-be5f-4c4c32dd6731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:44.123462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c3cc-a25c-4edf-be5f-4c4c32dd6731 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:44.123755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c3cc-a25c-4edf-be5f-4c4c32dd6731 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:44.124062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c3cc-a25c-4edf-be5f-4c4c32dd6731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:44.159897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114c3be-7be3-49f4-b65b-7d5baa6cc64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:44.160535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114c3be-7be3-49f4-b65b-7d5baa6cc64a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:44.160821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114c3be-7be3-49f4-b65b-7d5baa6cc64a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:44.161097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114c3be-7be3-49f4-b65b-7d5baa6cc64a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:44.161883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114c3be-7be3-49f4-b65b-7d5baa6cc64a None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=a32f116145b24d39a2550f593e4529e5, user.id=fb7a2fa249f749f78b04125a85a4ef31) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:44.162198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114c3be-7be3-49f4-b65b-7d5baa6cc64a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:44.163663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114c3be-7be3-49f4-b65b-7d5baa6cc64a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:44.175806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 129/266] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:43 2022] GET /identity/v3/role_assignments?user.id=fb7a2fa249f749f78b04125a85a4ef31&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:44.269275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780c3cc-a25c-4edf-be5f-4c4c32dd6731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:44.270831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780c3cc-a25c-4edf-be5f-4c4c32dd6731 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:44.432888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 138/267] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:44.440120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114c3be-7be3-49f4-b65b-7d5baa6cc64a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:44.502615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2b7f-89c3-43bb-a700-80054933a378 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:44.502949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2b7f-89c3-43bb-a700-80054933a378 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:44.503170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2b7f-89c3-43bb-a700-80054933a378 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:44.504811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 139/268] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:44.505860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0281-c21d-4648-a265-03c6b287c4ba None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:44.506148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0281-c21d-4648-a265-03c6b287c4ba None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:44.506423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0281-c21d-4648-a265-03c6b287c4ba None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:44.507752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 140/269] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:44.518038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cf7ac-12f4-4e58-93a8-ad2264440124 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:44.518219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cf7ac-12f4-4e58-93a8-ad2264440124 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:44.518467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cf7ac-12f4-4e58-93a8-ad2264440124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:44.544968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-7f4cf7ac-12f4-4e58-93a8-ad2264440124 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:44.546304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7f4cf7ac-12f4-4e58-93a8-ad2264440124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:44.576248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:44.611231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114c3be-7be3-49f4-b65b-7d5baa6cc64a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:44.627707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:44.649160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 141/270] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:44.652884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5e4e-800a-46b4-babe-dd741d96fa26 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:44.653189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5e4e-800a-46b4-babe-dd741d96fa26 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:44.653518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5e4e-800a-46b4-babe-dd741d96fa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:44.690844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81e20f-d058-4615-872a-f3d8b89b5705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:44.691441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81e20f-d058-4615-872a-f3d8b89b5705 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:44.691717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81e20f-d058-4615-872a-f3d8b89b5705 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:44.691986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81e20f-d058-4615-872a-f3d8b89b5705 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:44.694220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81e20f-d058-4615-872a-f3d8b89b5705 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:44.695700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81e20f-d058-4615-872a-f3d8b89b5705 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:44.700206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-517a5e4e-800a-46b4-babe-dd741d96fa26 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:44.701477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-517a5e4e-800a-46b4-babe-dd741d96fa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:44.703214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 130/271] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:44 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:44.714310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81e20f-d058-4615-872a-f3d8b89b5705 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:44.862093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81e20f-d058-4615-872a-f3d8b89b5705 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:44.879001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 142/272] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:44.900663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea1b84-f83a-403b-9955-3c7902e43e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:44.901414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea1b84-f83a-403b-9955-3c7902e43e36 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:44.901704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea1b84-f83a-403b-9955-3c7902e43e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:44.901980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea1b84-f83a-403b-9955-3c7902e43e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:44.902778 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea1b84-f83a-403b-9955-3c7902e43e36 None admin] RBAC: Adding query filter params (role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=a32f116145b24d39a2550f593e4529e5, user.id=fb7a2fa249f749f78b04125a85a4ef31) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:44.903089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea1b84-f83a-403b-9955-3c7902e43e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:44.904655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea1b84-f83a-403b-9955-3c7902e43e36 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:44.912355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 131/273] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:44 2022] GET /identity/v3/role_assignments?user.id=fb7a2fa249f749f78b04125a85a4ef31&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:45.015437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a5e4e-800a-46b4-babe-dd741d96fa26 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:45.142341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:45.163570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a5e4e-800a-46b4-babe-dd741d96fa26 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:45.210349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac62300-a7d1-46fd-bca3-afca5776c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:45.211339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac62300-a7d1-46fd-bca3-afca5776c62f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:45.211777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac62300-a7d1-46fd-bca3-afca5776c62f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:45.212217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac62300-a7d1-46fd-bca3-afca5776c62f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:45.213732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac62300-a7d1-46fd-bca3-afca5776c62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:45.215526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac62300-a7d1-46fd-bca3-afca5776c62f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:45.218060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 143/274] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:45.224669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea1b84-f83a-403b-9955-3c7902e43e36 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:45.233025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac62300-a7d1-46fd-bca3-afca5776c62f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:45.301025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:45.382738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea1b84-f83a-403b-9955-3c7902e43e36 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:45.388322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac62300-a7d1-46fd-bca3-afca5776c62f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:45.420201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4941624-a4f7-43e6-a4a8-14ab411ad428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:45.420824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941624-a4f7-43e6-a4a8-14ab411ad428 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:45.421682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941624-a4f7-43e6-a4a8-14ab411ad428 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:45.421954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941624-a4f7-43e6-a4a8-14ab411ad428 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:45.422727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4941624-a4f7-43e6-a4a8-14ab411ad428 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:45.424196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4941624-a4f7-43e6-a4a8-14ab411ad428 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:45.425853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ef2f5-955f-40c5-b7b6-c4f5b3c6a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:45.426498 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ef2f5-955f-40c5-b7b6-c4f5b3c6a508 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:45.426777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ef2f5-955f-40c5-b7b6-c4f5b3c6a508 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:45.427051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ef2f5-955f-40c5-b7b6-c4f5b3c6a508 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:45.438525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ef2f5-955f-40c5-b7b6-c4f5b3c6a508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-ee5ef2f5-955f-40c5-b7b6-c4f5b3c6a508 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:45.443614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:45.444755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:45.445602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 144/275] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:45.446238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 132/276] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:11:45 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:45.446307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f1c9c-8c2a-467c-9de9-258cad6739a2 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:45.446380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9de09-3a46-4e6f-878a-9dbb86652bfd None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:45.446454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f1c9c-8c2a-467c-9de9-258cad6739a2 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:45.446529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9de09-3a46-4e6f-878a-9dbb86652bfd None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:45.446897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9de09-3a46-4e6f-878a-9dbb86652bfd None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:45.447160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f1c9c-8c2a-467c-9de9-258cad6739a2 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:45.448135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 133/277] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:45.449888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 145/278] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:45.450887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9de09-3a46-4e6f-878a-9dbb86652bfd None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:45.461998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6f36c-00b0-4b7a-a66e-98af536d4df6 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:45.462446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6f36c-00b0-4b7a-a66e-98af536d4df6 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:45.462677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6f36c-00b0-4b7a-a66e-98af536d4df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:45.484565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-04a6f36c-00b0-4b7a-a66e-98af536d4df6 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:45.485939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-04a6f36c-00b0-4b7a-a66e-98af536d4df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:45.489537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:45.586967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 146/279] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:45.586967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336226-63a8-43fd-be14-61d269a96ff1 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:45.586967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336226-63a8-43fd-be14-61d269a96ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:45.586967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336226-63a8-43fd-be14-61d269a96ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:45.594735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:45.601563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9de09-3a46-4e6f-878a-9dbb86652bfd None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:45.601996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-dc336226-63a8-43fd-be14-61d269a96ff1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:45.603266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dc336226-63a8-43fd-be14-61d269a96ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:45.651609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985ba0-d86c-465b-b20c-0da77db8500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:45.652588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985ba0-d86c-465b-b20c-0da77db8500f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:45.653062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985ba0-d86c-465b-b20c-0da77db8500f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:45.653543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985ba0-d86c-465b-b20c-0da77db8500f None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:45.654466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66985ba0-d86c-465b-b20c-0da77db8500f None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:45.654772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66985ba0-d86c-465b-b20c-0da77db8500f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:45.659035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66985ba0-d86c-465b-b20c-0da77db8500f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:45.669524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 134/280] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:45.679312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985ba0-d86c-465b-b20c-0da77db8500f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:45.698918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 147/281] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:45.826537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985ba0-d86c-465b-b20c-0da77db8500f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:45.872934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70532ef5-50d6-42ac-8afc-06885b5fb50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:45.873547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532ef5-50d6-42ac-8afc-06885b5fb50f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:45.873824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532ef5-50d6-42ac-8afc-06885b5fb50f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:45.874168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532ef5-50d6-42ac-8afc-06885b5fb50f None admin] PATH_INFO: `/v3/users/2ad1969c591442a59ea50cd187402f50` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:45.883866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc336226-63a8-43fd-be14-61d269a96ff1 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:45.892228 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70532ef5-50d6-42ac-8afc-06885b5fb50f None admin] RBAC: Authorizing `identity:get_user(user_id=2ad1969c591442a59ea50cd187402f50)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:45.893855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70532ef5-50d6-42ac-8afc-06885b5fb50f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:45.895839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 135/282] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:45 2022] GET /identity/v3/users/2ad1969c591442a59ea50cd187402f50 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:45.901488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70532ef5-50d6-42ac-8afc-06885b5fb50f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:45.929419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:46.009619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:46.039067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70532ef5-50d6-42ac-8afc-06885b5fb50f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:46.046586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc336226-63a8-43fd-be14-61d269a96ff1 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:46.086749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3aa6e-9d13-4935-81b6-62807ae4eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:46.087403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3aa6e-9d13-4935-81b6-62807ae4eb8c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:46.087675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3aa6e-9d13-4935-81b6-62807ae4eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:46.087958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3aa6e-9d13-4935-81b6-62807ae4eb8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:46.090546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b64fd-0fac-465e-a2e6-8e164f317046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:46.091699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b64fd-0fac-465e-a2e6-8e164f317046 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:46.092151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b64fd-0fac-465e-a2e6-8e164f317046 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:46.092625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b64fd-0fac-465e-a2e6-8e164f317046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:46.094032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b64fd-0fac-465e-a2e6-8e164f317046 None admin] RBAC: Adding query filter params (role.id=7c59786364c04f0087154923c39fa449, user.id=2ad1969c591442a59ea50cd187402f50, scope.system=all) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:46.094487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b64fd-0fac-465e-a2e6-8e164f317046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:46.096729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b64fd-0fac-465e-a2e6-8e164f317046 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:46.099329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3aa6e-9d13-4935-81b6-62807ae4eb8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:46.103185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 136/283] 10.222.0.61 () {56 vars in 1308 bytes} [Thu Sep 22 18:11:45 2022] GET /identity/v3/role_assignments?user.id=2ad1969c591442a59ea50cd187402f50&scope.system=all&role.id=7c59786364c04f0087154923c39fa449 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:46.104334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b64fd-0fac-465e-a2e6-8e164f317046 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-8ef3aa6e-9d13-4935-81b6-62807ae4eb8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:46.104448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:46.105514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:46.111189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 148/284] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:46.113728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3aa6e-9d13-4935-81b6-62807ae4eb8c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:46.284448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3aa6e-9d13-4935-81b6-62807ae4eb8c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:46.294699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:46.320893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:46.328607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1de3b4-00a9-4f81-af48-99997d2b2ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:46.329286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1de3b4-00a9-4f81-af48-99997d2b2ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:46.329532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1de3b4-00a9-4f81-af48-99997d2b2ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:46.329800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1de3b4-00a9-4f81-af48-99997d2b2ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:46.330470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1de3b4-00a9-4f81-af48-99997d2b2ec9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:46.330777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1de3b4-00a9-4f81-af48-99997d2b2ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:46.332445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1de3b4-00a9-4f81-af48-99997d2b2ec9 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:46.339647 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b64fd-0fac-465e-a2e6-8e164f317046 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:46.344410 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 149/285] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:46.350267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1de3b4-00a9-4f81-af48-99997d2b2ec9 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:46.379990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a891ba-d1e5-43f8-be45-410e2f16efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:46.380637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a891ba-d1e5-43f8-be45-410e2f16efd7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:46.380916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a891ba-d1e5-43f8-be45-410e2f16efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:46.381188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a891ba-d1e5-43f8-be45-410e2f16efd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:46.396267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a891ba-d1e5-43f8-be45-410e2f16efd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-58a891ba-d1e5-43f8-be45-410e2f16efd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:46.403446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:46.404340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:46.406148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 137/286] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:46.410973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a891ba-d1e5-43f8-be45-410e2f16efd7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:46.540167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1de3b4-00a9-4f81-af48-99997d2b2ec9 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:46.611643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10d742-6b31-411d-adc0-755dcbb02d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:46.612626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10d742-6b31-411d-adc0-755dcbb02d22 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:46.613367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10d742-6b31-411d-adc0-755dcbb02d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:46.614499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10d742-6b31-411d-adc0-755dcbb02d22 None admin] PATH_INFO: `/v3/users/109cf9b0b9324a99bcfc0a906cb9f061` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:46.616613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10d742-6b31-411d-adc0-755dcbb02d22 None admin] RBAC: Authorizing `identity:get_user(user_id=109cf9b0b9324a99bcfc0a906cb9f061)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:46.618440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10d742-6b31-411d-adc0-755dcbb02d22 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:46.630974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 150/287] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:46 2022] GET /identity/v3/users/109cf9b0b9324a99bcfc0a906cb9f061 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:46.631553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a891ba-d1e5-43f8-be45-410e2f16efd7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:46.635121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10d742-6b31-411d-adc0-755dcbb02d22 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:46.695805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0e13-6b02-4812-92ba-d738ef1d0a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:46.696493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0e13-6b02-4812-92ba-d738ef1d0a9e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:46.696778 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0e13-6b02-4812-92ba-d738ef1d0a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:46.697060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0e13-6b02-4812-92ba-d738ef1d0a9e None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:46.697822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0e13-6b02-4812-92ba-d738ef1d0a9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:46.698136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0e13-6b02-4812-92ba-d738ef1d0a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:46.701273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef0e13-6b02-4812-92ba-d738ef1d0a9e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:46.713483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 138/288] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:46.720421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0e13-6b02-4812-92ba-d738ef1d0a9e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:46.726677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:46.803913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:46.853745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0e13-6b02-4812-92ba-d738ef1d0a9e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:46.896268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d3a96-0d70-4496-ba9c-d91b6f1cc00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:46.898454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d3a96-0d70-4496-ba9c-d91b6f1cc00b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:46.899025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d3a96-0d70-4496-ba9c-d91b6f1cc00b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:46.900295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d3a96-0d70-4496-ba9c-d91b6f1cc00b None admin] PATH_INFO: `/v3/users/92a982a495ac44688acfa81d10b4cec3` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:46.902677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d3a96-0d70-4496-ba9c-d91b6f1cc00b None admin] RBAC: Authorizing `identity:get_user(user_id=92a982a495ac44688acfa81d10b4cec3)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:46.906275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10d742-6b31-411d-adc0-755dcbb02d22 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:46.907260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d3a96-0d70-4496-ba9c-d91b6f1cc00b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:46.910484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 139/289] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:46 2022] GET /identity/v3/users/92a982a495ac44688acfa81d10b4cec3 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:46.918195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d3a96-0d70-4496-ba9c-d91b6f1cc00b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:46.953772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed973a-5540-4151-96f5-5925d936c936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:46.954397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed973a-5540-4151-96f5-5925d936c936 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:46.954676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed973a-5540-4151-96f5-5925d936c936 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:46.954947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed973a-5540-4151-96f5-5925d936c936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:47.067757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:47.094875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed973a-5540-4151-96f5-5925d936c936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:47.096381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed973a-5540-4151-96f5-5925d936c936 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:47.129252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d3a96-0d70-4496-ba9c-d91b6f1cc00b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:47.165109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:47.185639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171666-2e5b-4899-9c7f-7069ece84faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:47.186296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171666-2e5b-4899-9c7f-7069ece84faa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:47.187144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171666-2e5b-4899-9c7f-7069ece84faa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:47.187415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171666-2e5b-4899-9c7f-7069ece84faa None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:47.188610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9171666-2e5b-4899-9c7f-7069ece84faa None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:47.190160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9171666-2e5b-4899-9c7f-7069ece84faa None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:47.192152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 140/290] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:46 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:47.197979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171666-2e5b-4899-9c7f-7069ece84faa None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:47.219995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 151/291] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:47.221359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed973a-5540-4151-96f5-5925d936c936 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:47.331671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed973a-5540-4151-96f5-5925d936c936 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:47.368151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d52de5-27a4-4d3f-b201-55181b7e6fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:47.368822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d52de5-27a4-4d3f-b201-55181b7e6fef None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:47.369107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d52de5-27a4-4d3f-b201-55181b7e6fef None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:47.369418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d52de5-27a4-4d3f-b201-55181b7e6fef None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:47.370717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d52de5-27a4-4d3f-b201-55181b7e6fef None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:47.372272 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d52de5-27a4-4d3f-b201-55181b7e6fef None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:47.379729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 152/292] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:47 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:47.381035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d52de5-27a4-4d3f-b201-55181b7e6fef None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:47.393357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171666-2e5b-4899-9c7f-7069ece84faa None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:47.410192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:47.459771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc3ae-aac6-42cd-8249-11741afa4ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:47.460453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc3ae-aac6-42cd-8249-11741afa4ebd None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:47.460732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc3ae-aac6-42cd-8249-11741afa4ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:47.461008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc3ae-aac6-42cd-8249-11741afa4ebd None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5/users/92a982a495ac44688acfa81d10b4cec3/roles/8449438b350d420cb4d3a8450c21a891` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:47.467010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dc3ae-aac6-42cd-8249-11741afa4ebd None admin] RBAC: Authorizing `identity:create_grant(project_id=a32f116145b24d39a2550f593e4529e5, user_id=92a982a495ac44688acfa81d10b4cec3, role_id=8449438b350d420cb4d3a8450c21a891)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:47.469009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dc3ae-aac6-42cd-8249-11741afa4ebd None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:47.482494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:47.490994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 141/293] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:11:47 2022] PUT /identity/v3/projects/a32f116145b24d39a2550f593e4529e5/users/92a982a495ac44688acfa81d10b4cec3/roles/8449438b350d420cb4d3a8450c21a891 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:11:47.491502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d52de5-27a4-4d3f-b201-55181b7e6fef None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:47.532457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cac90f-fb25-41e2-95a2-c91455d4be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:47.533299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cac90f-fb25-41e2-95a2-c91455d4be7a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:47.533614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cac90f-fb25-41e2-95a2-c91455d4be7a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:47.533929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cac90f-fb25-41e2-95a2-c91455d4be7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:47.534748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cac90f-fb25-41e2-95a2-c91455d4be7a None admin] RBAC: Adding query filter params (role.id=7c59786364c04f0087154923c39fa449, scope.project.id=a32f116145b24d39a2550f593e4529e5, user.id=109cf9b0b9324a99bcfc0a906cb9f061) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:47.535086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cac90f-fb25-41e2-95a2-c91455d4be7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:47.536706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cac90f-fb25-41e2-95a2-c91455d4be7a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:47.549331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 153/294] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:47 2022] GET /identity/v3/role_assignments?user.id=109cf9b0b9324a99bcfc0a906cb9f061&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=7c59786364c04f0087154923c39fa449 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:48.111175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37bb82-25a3-44a5-b2cd-7a87b9bd6c83 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:48.111380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37bb82-25a3-44a5-b2cd-7a87b9bd6c83 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:48.111659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37bb82-25a3-44a5-b2cd-7a87b9bd6c83 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:48.113299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 142/295] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:48.118569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d091e-20c2-4de9-a8e2-b85601f4b0ef None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:48.118853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d091e-20c2-4de9-a8e2-b85601f4b0ef None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:48.119130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d091e-20c2-4de9-a8e2-b85601f4b0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:48.142222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-ec2d091e-20c2-4de9-a8e2-b85601f4b0ef None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:48.143423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ec2d091e-20c2-4de9-a8e2-b85601f4b0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:48.154393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b35873-b335-4127-9199-7932fcbbca0e None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:48.154672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b35873-b335-4127-9199-7932fcbbca0e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:48.154953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b35873-b335-4127-9199-7932fcbbca0e None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:48.156612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 143/296] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:48.161956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e283-e1e7-4a04-84a9-62e7ff5ce126 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:48.162243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e283-e1e7-4a04-84a9-62e7ff5ce126 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:48.162523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e283-e1e7-4a04-84a9-62e7ff5ce126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:48.183159 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a074e283-e1e7-4a04-84a9-62e7ff5ce126 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:48.184363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a074e283-e1e7-4a04-84a9-62e7ff5ce126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:48.222699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 154/297] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:48.268560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 144/298] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:48.496215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d091e-20c2-4de9-a8e2-b85601f4b0ef None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:48.522694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:48.547507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074e283-e1e7-4a04-84a9-62e7ff5ce126 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:48.631381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d091e-20c2-4de9-a8e2-b85601f4b0ef None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:48.671026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074e283-e1e7-4a04-84a9-62e7ff5ce126 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:48.675770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49022b0-2fc1-49a8-995a-f151ad2e6251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:48.676442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49022b0-2fc1-49a8-995a-f151ad2e6251 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:48.676725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49022b0-2fc1-49a8-995a-f151ad2e6251 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:48.676999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49022b0-2fc1-49a8-995a-f151ad2e6251 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:48.678239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49022b0-2fc1-49a8-995a-f151ad2e6251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:48.679758 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49022b0-2fc1-49a8-995a-f151ad2e6251 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:48.686149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 155/299] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:48.687091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49022b0-2fc1-49a8-995a-f151ad2e6251 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:48.713738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:48.716197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc29f6-7b5f-49fb-b118-b5adf567078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:48.717226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc29f6-7b5f-49fb-b118-b5adf567078e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:48.719544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc29f6-7b5f-49fb-b118-b5adf567078e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:48.719947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc29f6-7b5f-49fb-b118-b5adf567078e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:48.738817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc29f6-7b5f-49fb-b118-b5adf567078e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-6cfc29f6-7b5f-49fb-b118-b5adf567078e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:48.746710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:48.747776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:48.748573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:48.749194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 145/300] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:48.756514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc29f6-7b5f-49fb-b118-b5adf567078e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:48.807201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:48.820651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49022b0-2fc1-49a8-995a-f151ad2e6251 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:48.862004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544bab-fd11-4695-81c7-a2f47c19c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:48.863176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544bab-fd11-4695-81c7-a2f47c19c0fe None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:48.863176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544bab-fd11-4695-81c7-a2f47c19c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:48.863176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544bab-fd11-4695-81c7-a2f47c19c0fe None admin] PATH_INFO: `/v3/groups` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:48.863821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1544bab-fd11-4695-81c7-a2f47c19c0fe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:48.865444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1544bab-fd11-4695-81c7-a2f47c19c0fe None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:48.885594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 156/301] 10.222.0.61 () {60 vars in 1134 bytes} [Thu Sep 22 18:11:48 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:48.898039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc29f6-7b5f-49fb-b118-b5adf567078e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:48.940257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f16e7-78b1-46b9-9cfa-ac3e46c1cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:48.941147 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f16e7-78b1-46b9-9cfa-ac3e46c1cd8c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:48.941654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f16e7-78b1-46b9-9cfa-ac3e46c1cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:48.942070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f16e7-78b1-46b9-9cfa-ac3e46c1cd8c None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:48.942916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f16e7-78b1-46b9-9cfa-ac3e46c1cd8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:48.943370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f16e7-78b1-46b9-9cfa-ac3e46c1cd8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:48.945000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f16e7-78b1-46b9-9cfa-ac3e46c1cd8c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:48.957065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 146/302] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:48.963723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544bab-fd11-4695-81c7-a2f47c19c0fe None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:49.004343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049635f-15ba-46ed-b699-982b0f721871 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:49.004523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049635f-15ba-46ed-b699-982b0f721871 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:49.004802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049635f-15ba-46ed-b699-982b0f721871 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:49.006506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 147/303] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:49.015717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8f8b-cb02-44a2-b706-ed3a72e0f1b4 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:49.015717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8f8b-cb02-44a2-b706-ed3a72e0f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:49.016112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8f8b-cb02-44a2-b706-ed3a72e0f1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:49.037672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-025a8f8b-cb02-44a2-b706-ed3a72e0f1b4 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:49.039317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-025a8f8b-cb02-44a2-b706-ed3a72e0f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:49.087540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544bab-fd11-4695-81c7-a2f47c19c0fe None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:49.100636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:49.135416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 148/304] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:49.140416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d537508-5b36-4022-94b5-fdccb10763b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:49.141517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d537508-5b36-4022-94b5-fdccb10763b2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:49.141806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d537508-5b36-4022-94b5-fdccb10763b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:49.142082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d537508-5b36-4022-94b5-fdccb10763b2 None admin] PATH_INFO: `/v3/users/194a627d2f184384b86ab73f77a9a0fb` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:49.159170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d537508-5b36-4022-94b5-fdccb10763b2 None admin] RBAC: Authorizing `identity:get_user(user_id=194a627d2f184384b86ab73f77a9a0fb)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:49.160721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d537508-5b36-4022-94b5-fdccb10763b2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:49.162786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 157/305] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:48 2022] GET /identity/v3/users/194a627d2f184384b86ab73f77a9a0fb => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:49.170346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a8f8b-cb02-44a2-b706-ed3a72e0f1b4 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:49.284822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a8f8b-cb02-44a2-b706-ed3a72e0f1b4 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:49.320878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96872c21-997e-449b-b901-898ed7c6275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:49.321518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96872c21-997e-449b-b901-898ed7c6275d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:49.321798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96872c21-997e-449b-b901-898ed7c6275d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:49.322125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96872c21-997e-449b-b901-898ed7c6275d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:49.322870 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96872c21-997e-449b-b901-898ed7c6275d None admin] RBAC: Adding query filter params (role.id=8449438b350d420cb4d3a8450c21a891, user.id=194a627d2f184384b86ab73f77a9a0fb, scope.system=all) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:49.323181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96872c21-997e-449b-b901-898ed7c6275d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:49.324600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96872c21-997e-449b-b901-898ed7c6275d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:49.330047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 149/306] 10.222.0.61 () {56 vars in 1308 bytes} [Thu Sep 22 18:11:49 2022] GET /identity/v3/role_assignments?user.id=194a627d2f184384b86ab73f77a9a0fb&scope.system=all&role.id=8449438b350d420cb4d3a8450c21a891 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:49.421740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d537508-5b36-4022-94b5-fdccb10763b2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:49.434485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:49.547061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d537508-5b36-4022-94b5-fdccb10763b2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:49.585755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8c5fd-4291-47b0-b72c-b879a31e891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:49.586780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8c5fd-4291-47b0-b72c-b879a31e891b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:49.587266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8c5fd-4291-47b0-b72c-b879a31e891b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:49.587740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8c5fd-4291-47b0-b72c-b879a31e891b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:49.599609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8c5fd-4291-47b0-b72c-b879a31e891b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-43e8c5fd-4291-47b0-b72c-b879a31e891b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:49.605123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:49.606022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:49.606794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:49.614886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 158/307] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:49.616743 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96872c21-997e-449b-b901-898ed7c6275d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:49.678881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:49.744736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96872c21-997e-449b-b901-898ed7c6275d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:49.785840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed20258-c4c4-4595-ab86-c3996c4250af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:49.786466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed20258-c4c4-4595-ab86-c3996c4250af None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:49.786792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed20258-c4c4-4595-ab86-c3996c4250af None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:49.787073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed20258-c4c4-4595-ab86-c3996c4250af None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:49.787741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed20258-c4c4-4595-ab86-c3996c4250af None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:49.788045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed20258-c4c4-4595-ab86-c3996c4250af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:49.789508 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed20258-c4c4-4595-ab86-c3996c4250af None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:49.800424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 150/308] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:49.805763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8c5fd-4291-47b0-b72c-b879a31e891b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:49.884522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:49.929478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8c5fd-4291-47b0-b72c-b879a31e891b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:49.967465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbcc93-4c33-4e3b-8647-1272aa96fcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:49.968650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbcc93-4c33-4e3b-8647-1272aa96fcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:49.968925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbcc93-4c33-4e3b-8647-1272aa96fcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:49.969196 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbcc93-4c33-4e3b-8647-1272aa96fcb7 None admin] PATH_INFO: `/v3/users/2ad1969c591442a59ea50cd187402f50` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:49.970475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbcc93-4c33-4e3b-8647-1272aa96fcb7 None admin] RBAC: Authorizing `identity:get_user(user_id=2ad1969c591442a59ea50cd187402f50)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:49.971940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbcc93-4c33-4e3b-8647-1272aa96fcb7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:49.973574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 159/309] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:49 2022] GET /identity/v3/users/2ad1969c591442a59ea50cd187402f50 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:49.979369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed20258-c4c4-4595-ab86-c3996c4250af None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:50.015903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c71d-1935-4044-85a9-ce9ab3be0e6d None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:50.016224 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c71d-1935-4044-85a9-ce9ab3be0e6d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:50.016452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c71d-1935-4044-85a9-ce9ab3be0e6d None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:50.018188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 160/310] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:50.025571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287be0d5-d666-4ac7-af15-7d053778ec35 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:50.025855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287be0d5-d666-4ac7-af15-7d053778ec35 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:50.026129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287be0d5-d666-4ac7-af15-7d053778ec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:50.047996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-287be0d5-d666-4ac7-af15-7d053778ec35 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:50.049391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-287be0d5-d666-4ac7-af15-7d053778ec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:50.107143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed20258-c4c4-4595-ab86-c3996c4250af None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:50.120430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:50.137373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 161/311] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:50.156293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a59fa-6403-4dd8-8f8b-502c0483e2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:50.157298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a59fa-6403-4dd8-8f8b-502c0483e2b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:50.157816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a59fa-6403-4dd8-8f8b-502c0483e2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:50.158331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a59fa-6403-4dd8-8f8b-502c0483e2b7 None admin] PATH_INFO: `/v3/system/users/2ad1969c591442a59ea50cd187402f50/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:50.159986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a59fa-6403-4dd8-8f8b-502c0483e2b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2ad1969c591442a59ea50cd187402f50, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:50.161637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a59fa-6403-4dd8-8f8b-502c0483e2b7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:50.173825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 151/312] 10.222.0.61 () {58 vars in 1334 bytes} [Thu Sep 22 18:11:49 2022] PUT /identity/v3/system/users/2ad1969c591442a59ea50cd187402f50/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:11:50.429888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287be0d5-d666-4ac7-af15-7d053778ec35 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:50.500183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:50.536505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287be0d5-d666-4ac7-af15-7d053778ec35 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:50.572603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3fda2-d524-4e64-9ac0-3aca36783e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:50.573666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3fda2-d524-4e64-9ac0-3aca36783e9f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:50.574145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3fda2-d524-4e64-9ac0-3aca36783e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:50.574610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3fda2-d524-4e64-9ac0-3aca36783e9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:50.586040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3fda2-d524-4e64-9ac0-3aca36783e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-dda3fda2-d524-4e64-9ac0-3aca36783e9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:50.591172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:50.592015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:50.592832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:50.595384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 162/313] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:50.601308 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a59fa-6403-4dd8-8f8b-502c0483e2b7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:50.716247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a59fa-6403-4dd8-8f8b-502c0483e2b7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:50.752593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7db7e2-b2fd-4ba6-9449-1054a871f7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:50.753220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7db7e2-b2fd-4ba6-9449-1054a871f7df None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:50.753525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7db7e2-b2fd-4ba6-9449-1054a871f7df None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:50.753797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7db7e2-b2fd-4ba6-9449-1054a871f7df None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:50.754466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7db7e2-b2fd-4ba6-9449-1054a871f7df None admin] RBAC: Adding query filter params (name=reader) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:50.754767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7db7e2-b2fd-4ba6-9449-1054a871f7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:50.756155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7db7e2-b2fd-4ba6-9449-1054a871f7df None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:50.766412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 152/314] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:50.772188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3fda2-d524-4e64-9ac0-3aca36783e9f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:50.878514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3fda2-d524-4e64-9ac0-3aca36783e9f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:50.909291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:50.918282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca988-ce67-4580-8402-08d846097515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:50.918938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca988-ce67-4580-8402-08d846097515 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:50.919220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca988-ce67-4580-8402-08d846097515 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:50.919497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca988-ce67-4580-8402-08d846097515 None admin] PATH_INFO: `/v3/users/92a982a495ac44688acfa81d10b4cec3` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:50.920634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca988-ce67-4580-8402-08d846097515 None admin] RBAC: Authorizing `identity:get_user(user_id=92a982a495ac44688acfa81d10b4cec3)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:50.922856 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca988-ce67-4580-8402-08d846097515 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:50.924746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 163/315] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:50 2022] GET /identity/v3/users/92a982a495ac44688acfa81d10b4cec3 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:50.930042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7db7e2-b2fd-4ba6-9449-1054a871f7df None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:50.966655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:51.038446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7db7e2-b2fd-4ba6-9449-1054a871f7df None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:51.078163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0809098-d7d3-4d9c-9fe6-b620842066ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:51.078794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809098-d7d3-4d9c-9fe6-b620842066ed None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:51.079078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809098-d7d3-4d9c-9fe6-b620842066ed None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:51.079347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809098-d7d3-4d9c-9fe6-b620842066ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:51.154517 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0809098-d7d3-4d9c-9fe6-b620842066ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:51.156235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0809098-d7d3-4d9c-9fe6-b620842066ed None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:51.197628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:51.268830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 153/316] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:51.275052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca988-ce67-4580-8402-08d846097515 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:51.287382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8178-4bc0-492f-b805-b7e116922d73 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:51.287695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8178-4bc0-492f-b805-b7e116922d73 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:51.287979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8178-4bc0-492f-b805-b7e116922d73 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:51.289613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 154/317] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:51.294865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02350c96-2a0b-484f-9546-ddfee6e04625 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:51.295155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02350c96-2a0b-484f-9546-ddfee6e04625 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:51.295432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02350c96-2a0b-484f-9546-ddfee6e04625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:51.317829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-02350c96-2a0b-484f-9546-ddfee6e04625 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:51.319142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-02350c96-2a0b-484f-9546-ddfee6e04625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:51.389886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca988-ce67-4580-8402-08d846097515 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:51.392711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 155/318] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:51.425735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05662b-0483-4bcb-97e6-b7fddb5cac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:51.426495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05662b-0483-4bcb-97e6-b7fddb5cac10 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:51.426772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05662b-0483-4bcb-97e6-b7fddb5cac10 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:51.427040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05662b-0483-4bcb-97e6-b7fddb5cac10 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:51.428154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05662b-0483-4bcb-97e6-b7fddb5cac10 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:51.429630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05662b-0483-4bcb-97e6-b7fddb5cac10 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:51.431317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 164/319] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:51 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:51.437169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02350c96-2a0b-484f-9546-ddfee6e04625 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:51.502355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:51.541988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02350c96-2a0b-484f-9546-ddfee6e04625 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:51.583551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f737d95-e259-479a-b8ef-8bcae41c3cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:51.584181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f737d95-e259-479a-b8ef-8bcae41c3cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:51.584464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f737d95-e259-479a-b8ef-8bcae41c3cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:51.584993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f737d95-e259-479a-b8ef-8bcae41c3cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:51.585840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f737d95-e259-479a-b8ef-8bcae41c3cf3 None admin] RBAC: Adding query filter params (role.id=8449438b350d420cb4d3a8450c21a891, scope.project.id=a32f116145b24d39a2550f593e4529e5, user.id=92a982a495ac44688acfa81d10b4cec3) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:51.586150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f737d95-e259-479a-b8ef-8bcae41c3cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:51.587649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f737d95-e259-479a-b8ef-8bcae41c3cf3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:51.594826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 156/320] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:11:51 2022] GET /identity/v3/role_assignments?user.id=92a982a495ac44688acfa81d10b4cec3&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=8449438b350d420cb4d3a8450c21a891 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:51.679902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474d18-6bba-4934-bc25-3c9d8dae7a4f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:51.680524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474d18-6bba-4934-bc25-3c9d8dae7a4f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:51.681000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474d18-6bba-4934-bc25-3c9d8dae7a4f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:51.683159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 165/321] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:51.683369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f737d95-e259-479a-b8ef-8bcae41c3cf3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:51.689532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345798f-8dd0-42b0-bc1b-0c6c05fa6d79 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:51.690148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345798f-8dd0-42b0-bc1b-0c6c05fa6d79 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:51.690677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345798f-8dd0-42b0-bc1b-0c6c05fa6d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:51.715008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1345798f-8dd0-42b0-bc1b-0c6c05fa6d79 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:51.717396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1345798f-8dd0-42b0-bc1b-0c6c05fa6d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:51.795624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:51.812820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f737d95-e259-479a-b8ef-8bcae41c3cf3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:51.813810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 166/322] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:51.842955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:51.852720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5645591-07f0-4931-9dd4-4cdf5a3a1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:51.853886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5645591-07f0-4931-9dd4-4cdf5a3a1944 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:51.853886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5645591-07f0-4931-9dd4-4cdf5a3a1944 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:51.853886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5645591-07f0-4931-9dd4-4cdf5a3a1944 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:51.855001 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5645591-07f0-4931-9dd4-4cdf5a3a1944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:51.856452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5645591-07f0-4931-9dd4-4cdf5a3a1944 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:51.859734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 157/323] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:51.864611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345798f-8dd0-42b0-bc1b-0c6c05fa6d79 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:51.968875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345798f-8dd0-42b0-bc1b-0c6c05fa6d79 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:52.003662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8826eb-a49b-42cd-af9b-c9158aea507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:52.004274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8826eb-a49b-42cd-af9b-c9158aea507b None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:52.004548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8826eb-a49b-42cd-af9b-c9158aea507b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:52.004820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8826eb-a49b-42cd-af9b-c9158aea507b None admin] PATH_INFO: `/v3/groups` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:52.005481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8826eb-a49b-42cd-af9b-c9158aea507b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:52.006910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8826eb-a49b-42cd-af9b-c9158aea507b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:52.029277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 167/324] 10.222.0.61 () {60 vars in 1134 bytes} [Thu Sep 22 18:11:51 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:11:52.082103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5645591-07f0-4931-9dd4-4cdf5a3a1944 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:52.197092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5645591-07f0-4931-9dd4-4cdf5a3a1944 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:52.237942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee60e7-5a36-47da-80da-8e9e97810582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:52.238940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee60e7-5a36-47da-80da-8e9e97810582 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:52.239220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee60e7-5a36-47da-80da-8e9e97810582 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:52.239495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee60e7-5a36-47da-80da-8e9e97810582 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:52.251383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee60e7-5a36-47da-80da-8e9e97810582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-f3ee60e7-5a36-47da-80da-8e9e97810582 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:52.257095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:52.258071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:52.258858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 158/325] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:52.264822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8826eb-a49b-42cd-af9b-c9158aea507b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:52.332491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:52.389412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f78b1b-6c5d-4e6a-b40d-0b3ea7538332 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:52.390121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8826eb-a49b-42cd-af9b-c9158aea507b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:52.390674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f78b1b-6c5d-4e6a-b40d-0b3ea7538332 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:52.391165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f78b1b-6c5d-4e6a-b40d-0b3ea7538332 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:52.393118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 159/326] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:52.404415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a68b94-f184-4c0b-9f56-1b8d1c684675 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:52.404415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a68b94-f184-4c0b-9f56-1b8d1c684675 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:52.404415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a68b94-f184-4c0b-9f56-1b8d1c684675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:52.428171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-21a68b94-f184-4c0b-9f56-1b8d1c684675 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:52.429407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-21a68b94-f184-4c0b-9f56-1b8d1c684675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:52.430773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75546525-0daf-4c06-93f0-4e20d3eec106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:52.431674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546525-0daf-4c06-93f0-4e20d3eec106 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:52.432159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546525-0daf-4c06-93f0-4e20d3eec106 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:52.432627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546525-0daf-4c06-93f0-4e20d3eec106 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:52.433399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75546525-0daf-4c06-93f0-4e20d3eec106 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:52.433711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75546525-0daf-4c06-93f0-4e20d3eec106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:52.435101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75546525-0daf-4c06-93f0-4e20d3eec106 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:52.446386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 168/327] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:52.452951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75546525-0daf-4c06-93f0-4e20d3eec106 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:52.497489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:52.520274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 160/328] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:52.586187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75546525-0daf-4c06-93f0-4e20d3eec106 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:52.603001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:52.628940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3012a-bdd2-4d75-b0cc-aa85e208b405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:52.629659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3012a-bdd2-4d75-b0cc-aa85e208b405 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:52.629946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3012a-bdd2-4d75-b0cc-aa85e208b405 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:52.630223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3012a-bdd2-4d75-b0cc-aa85e208b405 None admin] PATH_INFO: `/v3/users/194a627d2f184384b86ab73f77a9a0fb` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:52.631391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3012a-bdd2-4d75-b0cc-aa85e208b405 None admin] RBAC: Authorizing `identity:get_user(user_id=194a627d2f184384b86ab73f77a9a0fb)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:52.632962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3012a-bdd2-4d75-b0cc-aa85e208b405 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:52.634627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 169/329] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:52 2022] GET /identity/v3/users/194a627d2f184384b86ab73f77a9a0fb => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:52.640836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a68b94-f184-4c0b-9f56-1b8d1c684675 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:52.756283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a68b94-f184-4c0b-9f56-1b8d1c684675 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:52.799831 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdca2b5-8802-41a2-bf3a-e79d934337e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:52.800505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdca2b5-8802-41a2-bf3a-e79d934337e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:52.800788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdca2b5-8802-41a2-bf3a-e79d934337e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:52.801064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdca2b5-8802-41a2-bf3a-e79d934337e7 None admin] PATH_INFO: `/v3/system/users/194a627d2f184384b86ab73f77a9a0fb/roles/8449438b350d420cb4d3a8450c21a891` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:52.802535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdca2b5-8802-41a2-bf3a-e79d934337e7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=194a627d2f184384b86ab73f77a9a0fb, role_id=8449438b350d420cb4d3a8450c21a891)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:52.804232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdca2b5-8802-41a2-bf3a-e79d934337e7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:52.815267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 161/330] 10.222.0.61 () {58 vars in 1334 bytes} [Thu Sep 22 18:11:52 2022] PUT /identity/v3/system/users/194a627d2f184384b86ab73f77a9a0fb/roles/8449438b350d420cb4d3a8450c21a891 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:11:52.847142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3012a-bdd2-4d75-b0cc-aa85e208b405 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:52.998682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3012a-bdd2-4d75-b0cc-aa85e208b405 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:53.038654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b7ea8-7e54-4a47-b77d-20f7f044a27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:53.039307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b7ea8-7e54-4a47-b77d-20f7f044a27a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:53.039588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b7ea8-7e54-4a47-b77d-20f7f044a27a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:53.039859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b7ea8-7e54-4a47-b77d-20f7f044a27a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:53.050805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b7ea8-7e54-4a47-b77d-20f7f044a27a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-831b7ea8-7e54-4a47-b77d-20f7f044a27a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:53.056164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:53.057039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:53.057867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 170/331] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:53.065107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdca2b5-8802-41a2-bf3a-e79d934337e7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:53.130755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:53.190701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdca2b5-8802-41a2-bf3a-e79d934337e7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:53.239026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312cbe4-4e31-4741-9251-079202abec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:53.239681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cbe4-4e31-4741-9251-079202abec14 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:53.239964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cbe4-4e31-4741-9251-079202abec14 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:53.240241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312cbe4-4e31-4741-9251-079202abec14 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:53.240927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312cbe4-4e31-4741-9251-079202abec14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:53.241246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312cbe4-4e31-4741-9251-079202abec14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:53.242657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312cbe4-4e31-4741-9251-079202abec14 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:53.252984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 162/332] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:53.258912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b7ea8-7e54-4a47-b77d-20f7f044a27a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:53.339620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:53.412441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b7ea8-7e54-4a47-b77d-20f7f044a27a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:53.455724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43731d6d-2a4d-4385-9936-8c4e1d3c17c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:53.456720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43731d6d-2a4d-4385-9936-8c4e1d3c17c5 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:53.457200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43731d6d-2a4d-4385-9936-8c4e1d3c17c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:53.457707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43731d6d-2a4d-4385-9936-8c4e1d3c17c5 None admin] PATH_INFO: `/v3/users/2ad1969c591442a59ea50cd187402f50` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:53.459153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43731d6d-2a4d-4385-9936-8c4e1d3c17c5 None admin] RBAC: Authorizing `identity:get_user(user_id=2ad1969c591442a59ea50cd187402f50)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:53.461048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43731d6d-2a4d-4385-9936-8c4e1d3c17c5 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:53.465500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 171/333] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:53 2022] GET /identity/v3/users/2ad1969c591442a59ea50cd187402f50 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:53.469627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312cbe4-4e31-4741-9251-079202abec14 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:53.602882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312cbe4-4e31-4741-9251-079202abec14 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:53.620116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:53.646487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2142d-348a-49c6-8dae-15c74ea932ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:53.647114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2142d-348a-49c6-8dae-15c74ea932ef None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:53.647440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2142d-348a-49c6-8dae-15c74ea932ef None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:53.647720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2142d-348a-49c6-8dae-15c74ea932ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:53.648476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2142d-348a-49c6-8dae-15c74ea932ef None admin] RBAC: Adding query filter params (role.id=7c59786364c04f0087154923c39fa449, user.id=2ad1969c591442a59ea50cd187402f50, scope.system=all) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:53.648788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2142d-348a-49c6-8dae-15c74ea932ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:53.650270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2142d-348a-49c6-8dae-15c74ea932ef None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:53.678993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 163/334] 10.222.0.61 () {56 vars in 1308 bytes} [Thu Sep 22 18:11:53 2022] GET /identity/v3/role_assignments?user.id=2ad1969c591442a59ea50cd187402f50&scope.system=all&role.id=7c59786364c04f0087154923c39fa449 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:54.534449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70198a19-a71e-4817-a3fd-b9c7bf1ef66c None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:54.534963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70198a19-a71e-4817-a3fd-b9c7bf1ef66c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:54.535040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70198a19-a71e-4817-a3fd-b9c7bf1ef66c None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:54.536584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 172/335] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:54.542130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e0aa7-0711-45fb-8874-99f7a5a79352 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:54.542681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e0aa7-0711-45fb-8874-99f7a5a79352 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:54.542681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e0aa7-0711-45fb-8874-99f7a5a79352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:54.570369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-480e0aa7-0711-45fb-8874-99f7a5a79352 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:54.571606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-480e0aa7-0711-45fb-8874-99f7a5a79352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:54.655067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 164/336] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:55.125558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70198a19-a71e-4817-a3fd-b9c7bf1ef66c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:55.274004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70198a19-a71e-4817-a3fd-b9c7bf1ef66c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:55.289820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:55.318656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209250db-5d20-4964-a232-8f4d2c441ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:55.319265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209250db-5d20-4964-a232-8f4d2c441ebd None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:55.319554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209250db-5d20-4964-a232-8f4d2c441ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:55.319830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209250db-5d20-4964-a232-8f4d2c441ebd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:55.342283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209250db-5d20-4964-a232-8f4d2c441ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-209250db-5d20-4964-a232-8f4d2c441ebd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:55.347270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:55.348192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:55.349688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 173/337] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:55.354309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e0aa7-0711-45fb-8874-99f7a5a79352 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:55.379196 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab15b8-f25e-4b02-af8e-d9ab9b582b52 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:55.379497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab15b8-f25e-4b02-af8e-d9ab9b582b52 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:55.379684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab15b8-f25e-4b02-af8e-d9ab9b582b52 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:55.381273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 174/338] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:55.386521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96de98-c774-4a47-9e99-bef6956211d6 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:55.386793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96de98-c774-4a47-9e99-bef6956211d6 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:55.387074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96de98-c774-4a47-9e99-bef6956211d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:55.422375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-2d96de98-c774-4a47-9e99-bef6956211d6 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:55.423472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2d96de98-c774-4a47-9e99-bef6956211d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:55.491311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e0aa7-0711-45fb-8874-99f7a5a79352 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:55.493532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:55.552092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21075-22f0-472e-9115-2b533c5143b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:55.552725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21075-22f0-472e-9115-2b533c5143b8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:55.552987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21075-22f0-472e-9115-2b533c5143b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:55.553289 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21075-22f0-472e-9115-2b533c5143b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:55.553980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21075-22f0-472e-9115-2b533c5143b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:55.554286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21075-22f0-472e-9115-2b533c5143b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:55.555999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21075-22f0-472e-9115-2b533c5143b8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:55.567784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 165/339] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:55.573644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21075-22f0-472e-9115-2b533c5143b8 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:55.587007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 175/340] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:55.728888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21075-22f0-472e-9115-2b533c5143b8 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:55.775123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fd031-41ef-474d-a0aa-e9bc75dd5917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:55.775746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fd031-41ef-474d-a0aa-e9bc75dd5917 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:55.776029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fd031-41ef-474d-a0aa-e9bc75dd5917 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:55.776306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fd031-41ef-474d-a0aa-e9bc75dd5917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:55.817596 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:55.868029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fd031-41ef-474d-a0aa-e9bc75dd5917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:55.869520 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fd031-41ef-474d-a0aa-e9bc75dd5917 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:55.996298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 166/341] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 18:11:56.002338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96de98-c774-4a47-9e99-bef6956211d6 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:56.144102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fd031-41ef-474d-a0aa-e9bc75dd5917 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:56.193845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:56.198777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96de98-c774-4a47-9e99-bef6956211d6 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:56.272170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901253-57da-41cd-9c54-b69dde87cd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:56.272730 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901253-57da-41cd-9c54-b69dde87cd4f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:56.273010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901253-57da-41cd-9c54-b69dde87cd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:56.273298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901253-57da-41cd-9c54-b69dde87cd4f None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:56.278137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34901253-57da-41cd-9c54-b69dde87cd4f None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:56.279631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34901253-57da-41cd-9c54-b69dde87cd4f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:56.281989 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 176/342] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:56 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:56.287601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901253-57da-41cd-9c54-b69dde87cd4f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:56.289827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:56.385551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fd031-41ef-474d-a0aa-e9bc75dd5917 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:56.473860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901253-57da-41cd-9c54-b69dde87cd4f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:56.486052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de9ea2-c7f5-4a83-9f4c-5e27f24fb04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:56.486801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de9ea2-c7f5-4a83-9f4c-5e27f24fb04e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:56.487067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de9ea2-c7f5-4a83-9f4c-5e27f24fb04e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:56.487305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de9ea2-c7f5-4a83-9f4c-5e27f24fb04e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:56.520681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de9ea2-c7f5-4a83-9f4c-5e27f24fb04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-b1de9ea2-c7f5-4a83-9f4c-5e27f24fb04e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:56.525925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:56.527656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:56.530112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:56.535556 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 167/343] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:11:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:56.536456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de9ea2-c7f5-4a83-9f4c-5e27f24fb04e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:56.549283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cde7b-cdce-4fbb-a801-19fedcda448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:56.549283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cde7b-cdce-4fbb-a801-19fedcda448a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:56.549283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cde7b-cdce-4fbb-a801-19fedcda448a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:56.549283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cde7b-cdce-4fbb-a801-19fedcda448a None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:56.565824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cde7b-cdce-4fbb-a801-19fedcda448a None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:56.569003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cde7b-cdce-4fbb-a801-19fedcda448a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:56.572826 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 177/344] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:11:56 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:56.582339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cde7b-cdce-4fbb-a801-19fedcda448a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:56.640696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:56.728049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de9ea2-c7f5-4a83-9f4c-5e27f24fb04e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:56.731905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cde7b-cdce-4fbb-a801-19fedcda448a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:56.767345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:56.769138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d323bb-d121-4817-9c2c-25a2195db6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:56.770536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d323bb-d121-4817-9c2c-25a2195db6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:56.770536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d323bb-d121-4817-9c2c-25a2195db6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:56.770536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d323bb-d121-4817-9c2c-25a2195db6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:56.771400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d323bb-d121-4817-9c2c-25a2195db6c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:56.772050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d323bb-d121-4817-9c2c-25a2195db6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:56.772685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f8f35-9df4-44a9-8857-ec98fd224d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:56.773512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f8f35-9df4-44a9-8857-ec98fd224d82 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:56.773957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f8f35-9df4-44a9-8857-ec98fd224d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:56.774372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f8f35-9df4-44a9-8857-ec98fd224d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:56.774479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d323bb-d121-4817-9c2c-25a2195db6c7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:56.775340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f8f35-9df4-44a9-8857-ec98fd224d82 None admin] RBAC: Adding query filter params (group.id=d024406f3bde4641aed3891df17f16e9, role.id=7c59786364c04f0087154923c39fa449, scope.project.id=5039b090c00e4b52901878d5da90d9a4) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:56.775809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f8f35-9df4-44a9-8857-ec98fd224d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:56.777643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f8f35-9df4-44a9-8857-ec98fd224d82 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:56.784334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 168/345] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:11:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:56.784705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 178/346] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:11:56 2022] GET /identity/v3/role_assignments?group.id=d024406f3bde4641aed3891df17f16e9&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=7c59786364c04f0087154923c39fa449 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:11:56.789384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f78a1-525b-4288-9e1e-616ce4957c36 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:56.789384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f78a1-525b-4288-9e1e-616ce4957c36 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:56.789384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f78a1-525b-4288-9e1e-616ce4957c36 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:56.789384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 169/347] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:56.791051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c8a7-cd62-4ef6-8c7b-483a92284a4f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:56.791348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c8a7-cd62-4ef6-8c7b-483a92284a4f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:56.791627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7c8a7-cd62-4ef6-8c7b-483a92284a4f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:56.793272 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 179/348] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:56.794020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c8a7-cd62-4ef6-8c7b-483a92284a4f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:56.794692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43732e69-e9a6-40c0-9aec-e05f478ae2aa None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:56.795178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43732e69-e9a6-40c0-9aec-e05f478ae2aa None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:56.795666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43732e69-e9a6-40c0-9aec-e05f478ae2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:56.817070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-43732e69-e9a6-40c0-9aec-e05f478ae2aa None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:56.818915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-43732e69-e9a6-40c0-9aec-e05f478ae2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:56.900215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 170/349] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:56.901975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952786b-11fb-412d-aafa-021130d47a66 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:56.902455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952786b-11fb-412d-aafa-021130d47a66 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:56.902929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952786b-11fb-412d-aafa-021130d47a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:56.925057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-b952786b-11fb-412d-aafa-021130d47a66 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:56.926667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b952786b-11fb-412d-aafa-021130d47a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:56.940855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:56.951979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7c8a7-cd62-4ef6-8c7b-483a92284a4f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:57.007785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fd3b4-0016-43f4-bf61-5730952f76a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:57.008802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fd3b4-0016-43f4-bf61-5730952f76a3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:57.009799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fd3b4-0016-43f4-bf61-5730952f76a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:57.010295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fd3b4-0016-43f4-bf61-5730952f76a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:57.026396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 171/350] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:57.031245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8265a-e670-4806-803a-403b36eb23d0 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:57.031500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8265a-e670-4806-803a-403b36eb23d0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:57.031730 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8265a-e670-4806-803a-403b36eb23d0 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:57.033370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 172/351] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:11:57.045367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94684da7-264d-46bd-a34a-5746cd9ee6d3 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:57.045682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94684da7-264d-46bd-a34a-5746cd9ee6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:57.046461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94684da7-264d-46bd-a34a-5746cd9ee6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:57.080552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-94684da7-264d-46bd-a34a-5746cd9ee6d3 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:57.081817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-94684da7-264d-46bd-a34a-5746cd9ee6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:57.104123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fd3b4-0016-43f4-bf61-5730952f76a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:57.106405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fd3b4-0016-43f4-bf61-5730952f76a3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:57.160148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:57.193666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 173/352] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:11:57.222035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:57.230682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 180/353] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:57.236735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94684da7-264d-46bd-a34a-5746cd9ee6d3 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:57.365682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94684da7-264d-46bd-a34a-5746cd9ee6d3 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:57.409673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca87032-4142-41b3-bf49-6e557f7aad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:57.410324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca87032-4142-41b3-bf49-6e557f7aad28 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:57.410607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca87032-4142-41b3-bf49-6e557f7aad28 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:57.410883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca87032-4142-41b3-bf49-6e557f7aad28 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:57.412035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca87032-4142-41b3-bf49-6e557f7aad28 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:57.413496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca87032-4142-41b3-bf49-6e557f7aad28 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:57.415132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 174/354] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:57 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:57.420672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fd3b4-0016-43f4-bf61-5730952f76a3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:57.435068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca87032-4142-41b3-bf49-6e557f7aad28 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:57.516328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:57.563550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fd3b4-0016-43f4-bf61-5730952f76a3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:57.626280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca87032-4142-41b3-bf49-6e557f7aad28 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:57.641871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7d6c8-031e-4276-b0b6-5a137847d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:57.643269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7d6c8-031e-4276-b0b6-5a137847d307 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:57.643754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7d6c8-031e-4276-b0b6-5a137847d307 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:57.644270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7d6c8-031e-4276-b0b6-5a137847d307 None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:57.645931 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7d6c8-031e-4276-b0b6-5a137847d307 None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:57.647615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7d6c8-031e-4276-b0b6-5a137847d307 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:57.649521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 181/355] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:11:57 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:57.652399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7d6c8-031e-4276-b0b6-5a137847d307 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:57.716318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fccc6e-e663-42db-9014-17287d6116c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:57.718964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fccc6e-e663-42db-9014-17287d6116c6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:57.719497 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fccc6e-e663-42db-9014-17287d6116c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:57.720037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fccc6e-e663-42db-9014-17287d6116c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:57.735294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fccc6e-e663-42db-9014-17287d6116c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-d1fccc6e-e663-42db-9014-17287d6116c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:57.742848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:57.743965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:11:57.744989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:57.748396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 175/356] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:11:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:11:57.749785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fccc6e-e663-42db-9014-17287d6116c6 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:57.765514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:57.820055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7d6c8-031e-4276-b0b6-5a137847d307 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:57.880941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7f7a-55f1-4eda-b6cf-ce32e27c2f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:57.881945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7f7a-55f1-4eda-b6cf-ce32e27c2f2d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:57.882411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7f7a-55f1-4eda-b6cf-ce32e27c2f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:57.882559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fccc6e-e663-42db-9014-17287d6116c6 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:57.882973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7f7a-55f1-4eda-b6cf-ce32e27c2f2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:57.884653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:57.900569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7f7a-55f1-4eda-b6cf-ce32e27c2f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-c5dc7f7a-55f1-4eda-b6cf-ce32e27c2f2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:57.907910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:57.909059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:11:57.909986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:57.913215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 182/357] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:57.914294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7f7a-55f1-4eda-b6cf-ce32e27c2f2d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:57.933327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fcda5-d181-406e-b804-f9d0f37413ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:57.933926 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fcda5-d181-406e-b804-f9d0f37413ef None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:57.934214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fcda5-d181-406e-b804-f9d0f37413ef None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:57.934547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fcda5-d181-406e-b804-f9d0f37413ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:57.935289 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fcda5-d181-406e-b804-f9d0f37413ef None admin] RBAC: Adding query filter params (group.id=d024406f3bde4641aed3891df17f16e9, role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=5039b090c00e4b52901878d5da90d9a4) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:57.935601 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fcda5-d181-406e-b804-f9d0f37413ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:57.937247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fcda5-d181-406e-b804-f9d0f37413ef None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:57.944528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 176/358] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:11:57 2022] GET /identity/v3/role_assignments?group.id=d024406f3bde4641aed3891df17f16e9&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:57.946121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fcda5-d181-406e-b804-f9d0f37413ef None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:58.052831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7f7a-55f1-4eda-b6cf-ce32e27c2f2d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:58.082972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:58.097266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fcda5-d181-406e-b804-f9d0f37413ef None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:58.100112 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256adbdb-4920-4195-92ba-2808d5854386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:58.100979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256adbdb-4920-4195-92ba-2808d5854386 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:58.101439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256adbdb-4920-4195-92ba-2808d5854386 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:58.101857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256adbdb-4920-4195-92ba-2808d5854386 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:58.115009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256adbdb-4920-4195-92ba-2808d5854386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-256adbdb-4920-4195-92ba-2808d5854386 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:58.120638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:58.121789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 18:11:58.122761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:11:58.125890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 183/359] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:58.127376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256adbdb-4920-4195-92ba-2808d5854386 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:58.137864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d7e68-c93f-42b8-9034-92d6c7eba110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:58.138418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7e68-c93f-42b8-9034-92d6c7eba110 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:58.138755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7e68-c93f-42b8-9034-92d6c7eba110 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:58.139035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7e68-c93f-42b8-9034-92d6c7eba110 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:58.140303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d7e68-c93f-42b8-9034-92d6c7eba110 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:58.140613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d7e68-c93f-42b8-9034-92d6c7eba110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:58.142256 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d7e68-c93f-42b8-9034-92d6c7eba110 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:58.154063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 177/360] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:11:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:58.155450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b83dd-3f59-4562-bd8a-e506262291da None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:58.155744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b83dd-3f59-4562-bd8a-e506262291da None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:58.156023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b83dd-3f59-4562-bd8a-e506262291da None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:58.157516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 178/361] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:58.158615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b83dd-3f59-4562-bd8a-e506262291da None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:58.214829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:58.275020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256adbdb-4920-4195-92ba-2808d5854386 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:58.302555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b83dd-3f59-4562-bd8a-e506262291da None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:58.318786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d739e4-13d8-4d91-8cbc-0e65740e15fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:58.319412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d739e4-13d8-4d91-8cbc-0e65740e15fb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:58.319695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d739e4-13d8-4d91-8cbc-0e65740e15fb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:58.319972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d739e4-13d8-4d91-8cbc-0e65740e15fb None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:58.320647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d739e4-13d8-4d91-8cbc-0e65740e15fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:58.321281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d739e4-13d8-4d91-8cbc-0e65740e15fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:58.322377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d739e4-13d8-4d91-8cbc-0e65740e15fb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:58.332510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 184/362] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:58.337380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d739e4-13d8-4d91-8cbc-0e65740e15fb None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:58.352197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebef3b-833c-4c12-947b-f4b207f448ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:58.352823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebef3b-833c-4c12-947b-f4b207f448ba None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:58.353105 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebef3b-833c-4c12-947b-f4b207f448ba None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:58.353429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebef3b-833c-4c12-947b-f4b207f448ba None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:58.354108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebef3b-833c-4c12-947b-f4b207f448ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:58.354413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebef3b-833c-4c12-947b-f4b207f448ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:58.356267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebef3b-833c-4c12-947b-f4b207f448ba None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:58.369143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 179/363] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:11:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:58.370918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841984bf-504d-46e8-888a-15a55c1bcb48 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:58.371208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841984bf-504d-46e8-888a-15a55c1bcb48 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:58.371481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841984bf-504d-46e8-888a-15a55c1bcb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:58.395300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-841984bf-504d-46e8-888a-15a55c1bcb48 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:11:58.396428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-841984bf-504d-46e8-888a-15a55c1bcb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:11:58.405201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:58.470977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d739e4-13d8-4d91-8cbc-0e65740e15fb None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:58.495632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 180/364] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:11:58.496501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841984bf-504d-46e8-888a-15a55c1bcb48 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:58.516368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2578a-d9e2-4f98-a018-ed4af70b9f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:58.516718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2578a-d9e2-4f98-a018-ed4af70b9f9c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:58.516953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2578a-d9e2-4f98-a018-ed4af70b9f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:58.517301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2578a-d9e2-4f98-a018-ed4af70b9f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:58.530824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:58.615301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2578a-d9e2-4f98-a018-ed4af70b9f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:58.616973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2578a-d9e2-4f98-a018-ed4af70b9f9c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:58.644047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841984bf-504d-46e8-888a-15a55c1bcb48 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:58.691273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b42d1-9f55-47b3-9097-d7f15762fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:58.692088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:58.693913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b42d1-9f55-47b3-9097-d7f15762fcec None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:58.694347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b42d1-9f55-47b3-9097-d7f15762fcec None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:58.695140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b42d1-9f55-47b3-9097-d7f15762fcec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:58.789045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 185/365] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:58.791929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2578a-d9e2-4f98-a018-ed4af70b9f9c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:58.808918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b42d1-9f55-47b3-9097-d7f15762fcec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:58.811229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b42d1-9f55-47b3-9097-d7f15762fcec None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:58.854740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:58.972449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 181/366] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:11:58.973362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b42d1-9f55-47b3-9097-d7f15762fcec None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:58.990394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2578a-d9e2-4f98-a018-ed4af70b9f9c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:59.038176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55e24d-5cd0-4880-8371-1a9b2ab9777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:59.039253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55e24d-5cd0-4880-8371-1a9b2ab9777c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.039714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55e24d-5cd0-4880-8371-1a9b2ab9777c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.040194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55e24d-5cd0-4880-8371-1a9b2ab9777c None admin] PATH_INFO: `/v3/users/194a627d2f184384b86ab73f77a9a0fb` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.041798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55e24d-5cd0-4880-8371-1a9b2ab9777c None admin] RBAC: Authorizing `identity:get_user(user_id=194a627d2f184384b86ab73f77a9a0fb)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:59.043676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55e24d-5cd0-4880-8371-1a9b2ab9777c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:59.045917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 186/367] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:11:58 2022] GET /identity/v3/users/194a627d2f184384b86ab73f77a9a0fb => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:59.047974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55e24d-5cd0-4880-8371-1a9b2ab9777c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:59.067915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:59.117463 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b42d1-9f55-47b3-9097-d7f15762fcec None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:59.146009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:59.162245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1351c-9136-4ad2-a90d-65444aeace7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:59.163345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1351c-9136-4ad2-a90d-65444aeace7c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.163907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1351c-9136-4ad2-a90d-65444aeace7c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.164404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1351c-9136-4ad2-a90d-65444aeace7c None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.165867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1351c-9136-4ad2-a90d-65444aeace7c None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:59.167538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1351c-9136-4ad2-a90d-65444aeace7c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:59.169680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 182/368] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:58 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:59.170723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1351c-9136-4ad2-a90d-65444aeace7c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:59.178991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55e24d-5cd0-4880-8371-1a9b2ab9777c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:59.238556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7006e65-30d2-4f43-a085-ee6bc11c9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:59.240449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7006e65-30d2-4f43-a085-ee6bc11c9a85 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.241188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7006e65-30d2-4f43-a085-ee6bc11c9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.242077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7006e65-30d2-4f43-a085-ee6bc11c9a85 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.244891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7006e65-30d2-4f43-a085-ee6bc11c9a85 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:59.248512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7006e65-30d2-4f43-a085-ee6bc11c9a85 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:59.253601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 187/369] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:11:59 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:59.255669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7006e65-30d2-4f43-a085-ee6bc11c9a85 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:59.291241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1351c-9136-4ad2-a90d-65444aeace7c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:59.339764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390eba7-1f52-4394-aace-b7d38fc424e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:59.340423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390eba7-1f52-4394-aace-b7d38fc424e6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.340738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390eba7-1f52-4394-aace-b7d38fc424e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.341013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390eba7-1f52-4394-aace-b7d38fc424e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.352780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390eba7-1f52-4394-aace-b7d38fc424e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-e390eba7-1f52-4394-aace-b7d38fc424e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:11:59.357819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:11:59.359275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:11:59.360077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 183/370] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:11:59.360747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390eba7-1f52-4394-aace-b7d38fc424e6 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:59.373284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:59.398279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7006e65-30d2-4f43-a085-ee6bc11c9a85 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:59.430699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:59.448938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a122-9697-403d-9217-7f16277e7546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:59.449819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a122-9697-403d-9217-7f16277e7546 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.450236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a122-9697-403d-9217-7f16277e7546 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.450747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a122-9697-403d-9217-7f16277e7546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.451634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63a122-9697-403d-9217-7f16277e7546 None admin] RBAC: Adding query filter params (role.id=8449438b350d420cb4d3a8450c21a891, user.id=194a627d2f184384b86ab73f77a9a0fb, scope.system=all) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:59.452088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63a122-9697-403d-9217-7f16277e7546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:59.456050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63a122-9697-403d-9217-7f16277e7546 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:59.471577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 188/371] 10.222.0.61 () {56 vars in 1308 bytes} [Thu Sep 22 18:11:59 2022] GET /identity/v3/role_assignments?user.id=194a627d2f184384b86ab73f77a9a0fb&scope.system=all&role.id=8449438b350d420cb4d3a8450c21a891 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:59.472651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a122-9697-403d-9217-7f16277e7546 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:59.504854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390eba7-1f52-4394-aace-b7d38fc424e6 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:59.561195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ced16-a0ca-48e7-b7f8-561f16ca38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:59.563444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ced16-a0ca-48e7-b7f8-561f16ca38f7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.563935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ced16-a0ca-48e7-b7f8-561f16ca38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.564409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ced16-a0ca-48e7-b7f8-561f16ca38f7 None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.566393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ced16-a0ca-48e7-b7f8-561f16ca38f7 None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:59.569476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ced16-a0ca-48e7-b7f8-561f16ca38f7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:59.571463 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 184/372] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:11:59 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:59.572482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ced16-a0ca-48e7-b7f8-561f16ca38f7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:59.606200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a122-9697-403d-9217-7f16277e7546 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:59.654665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0faf-44dd-44ad-8c4a-de3bb12fae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:59.656728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0faf-44dd-44ad-8c4a-de3bb12fae8f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.657281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0faf-44dd-44ad-8c4a-de3bb12fae8f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.657747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0faf-44dd-44ad-8c4a-de3bb12fae8f None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.659356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0faf-44dd-44ad-8c4a-de3bb12fae8f None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:59.666540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0faf-44dd-44ad-8c4a-de3bb12fae8f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:59.668537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 189/373] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:11:59 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:59.669194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0faf-44dd-44ad-8c4a-de3bb12fae8f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:59.696590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:59.768414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ced16-a0ca-48e7-b7f8-561f16ca38f7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:59.800914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:11:59.830359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e06c8-a626-4f0f-ac86-a750a0b02055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:59.831037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e06c8-a626-4f0f-ac86-a750a0b02055 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.831296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e06c8-a626-4f0f-ac86-a750a0b02055 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.831603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e06c8-a626-4f0f-ac86-a750a0b02055 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.832295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e06c8-a626-4f0f-ac86-a750a0b02055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:59.832577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e06c8-a626-4f0f-ac86-a750a0b02055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:59.834106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e06c8-a626-4f0f-ac86-a750a0b02055 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:59.847056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0faf-44dd-44ad-8c4a-de3bb12fae8f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:11:59.848547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 185/374] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:59.849715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e06c8-a626-4f0f-ac86-a750a0b02055 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:11:59.893214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dada3-e554-458a-a1cd-3275cb63dc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:11:59.894022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dada3-e554-458a-a1cd-3275cb63dc81 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.894436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dada3-e554-458a-a1cd-3275cb63dc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.894714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dada3-e554-458a-a1cd-3275cb63dc81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.895611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dada3-e554-458a-a1cd-3275cb63dc81 None admin] RBAC: Adding query filter params (group.id=d024406f3bde4641aed3891df17f16e9, role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=a32f116145b24d39a2550f593e4529e5) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:11:59.895919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dada3-e554-458a-a1cd-3275cb63dc81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:11:59.897722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dada3-e554-458a-a1cd-3275cb63dc81 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:11:59.908543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 190/375] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:11:59 2022] GET /identity/v3/role_assignments?group.id=d024406f3bde4641aed3891df17f16e9&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:11:59.910254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee318dd-2254-4c65-ac56-f532263811fa None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:11:59.910983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee318dd-2254-4c65-ac56-f532263811fa None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:11:59.911752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee318dd-2254-4c65-ac56-f532263811fa None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:11:59.917342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 191/376] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:11:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:11:59.918852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee318dd-2254-4c65-ac56-f532263811fa None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:00.013942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e06c8-a626-4f0f-ac86-a750a0b02055 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:00.026750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:00.076850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ae62b-28c9-4855-8b3e-848e3de59143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:00.078394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ae62b-28c9-4855-8b3e-848e3de59143 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:00.078504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee318dd-2254-4c65-ac56-f532263811fa None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:00.079020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ae62b-28c9-4855-8b3e-848e3de59143 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:00.079516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ae62b-28c9-4855-8b3e-848e3de59143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:00.080490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ae62b-28c9-4855-8b3e-848e3de59143 None admin] RBAC: Adding query filter params (group.id=d024406f3bde4641aed3891df17f16e9, role.id=7c59786364c04f0087154923c39fa449, scope.project.id=a32f116145b24d39a2550f593e4529e5) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:00.081011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ae62b-28c9-4855-8b3e-848e3de59143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:00.084129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ae62b-28c9-4855-8b3e-848e3de59143 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:00.091480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 186/377] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:11:59 2022] GET /identity/v3/role_assignments?group.id=d024406f3bde4641aed3891df17f16e9&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=7c59786364c04f0087154923c39fa449 => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:00.094251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b6bc-39a5-488a-a98d-516f80ec3dd8 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:00.094818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b6bc-39a5-488a-a98d-516f80ec3dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:00.096123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b6bc-39a5-488a-a98d-516f80ec3dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:00.120984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-24c5b6bc-39a5-488a-a98d-516f80ec3dd8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:00.123594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-24c5b6bc-39a5-488a-a98d-516f80ec3dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:00.143309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f634a1-35a9-471d-9346-2b8371f4b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:00.144069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f634a1-35a9-471d-9346-2b8371f4b40d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:00.144468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f634a1-35a9-471d-9346-2b8371f4b40d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:00.144757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f634a1-35a9-471d-9346-2b8371f4b40d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:00.187021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:00.234208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 187/378] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:00.256357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f634a1-35a9-471d-9346-2b8371f4b40d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:00.258289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f634a1-35a9-471d-9346-2b8371f4b40d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:00.369522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:00.411736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 192/379] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:00.417277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b6bc-39a5-488a-a98d-516f80ec3dd8 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:00.549393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b6bc-39a5-488a-a98d-516f80ec3dd8 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:00.607984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc451ce5-9dee-4113-9071-1f5a1f2a5b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:00.609194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc451ce5-9dee-4113-9071-1f5a1f2a5b56 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:00.609518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc451ce5-9dee-4113-9071-1f5a1f2a5b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:00.609794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc451ce5-9dee-4113-9071-1f5a1f2a5b56 None admin] PATH_INFO: `/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:00.611114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc451ce5-9dee-4113-9071-1f5a1f2a5b56 None admin] RBAC: Authorizing `identity:get_project(project_id=a9e60ccd9c384aa09ff28b8a6b6df44b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:00.612610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc451ce5-9dee-4113-9071-1f5a1f2a5b56 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:00.614409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 188/380] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:00 2022] GET /identity/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:00.620428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f634a1-35a9-471d-9346-2b8371f4b40d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:00.744961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765ffe7-826f-4823-94c5-b8662edc785b None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:00.745301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765ffe7-826f-4823-94c5-b8662edc785b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:00.745562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765ffe7-826f-4823-94c5-b8662edc785b None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:00.747204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 189/381] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:00.761010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765ffe7-826f-4823-94c5-b8662edc785b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:00.794471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f634a1-35a9-471d-9346-2b8371f4b40d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:00.818481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:00.845291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51021ce5-a7cd-429e-a267-cd302527b1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:00.845949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021ce5-a7cd-429e-a267-cd302527b1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:00.846230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021ce5-a7cd-429e-a267-cd302527b1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:00.846499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021ce5-a7cd-429e-a267-cd302527b1f3 None admin] PATH_INFO: `/v3/groups/e7cf23b2380a47cfa22783814b7aab50` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:00.852476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51021ce5-a7cd-429e-a267-cd302527b1f3 None admin] RBAC: Authorizing `identity:get_group(group_id=e7cf23b2380a47cfa22783814b7aab50)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:00.854085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51021ce5-a7cd-429e-a267-cd302527b1f3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:00.856174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 193/382] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:00 2022] GET /identity/v3/groups/e7cf23b2380a47cfa22783814b7aab50 => generated 229 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:00.857478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f805fed-64b9-4bbb-bd0b-a2c53303a55b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:00.857762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f805fed-64b9-4bbb-bd0b-a2c53303a55b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:00.858037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f805fed-64b9-4bbb-bd0b-a2c53303a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:00.886073 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5f805fed-64b9-4bbb-bd0b-a2c53303a55b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:00.887520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5f805fed-64b9-4bbb-bd0b-a2c53303a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:00.900680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765ffe7-826f-4823-94c5-b8662edc785b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:00.926681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:00.946845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab442f9d-6384-42ff-bbf4-16d11438997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:00.947501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab442f9d-6384-42ff-bbf4-16d11438997b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:00.947839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab442f9d-6384-42ff-bbf4-16d11438997b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:00.948113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab442f9d-6384-42ff-bbf4-16d11438997b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:00.960438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab442f9d-6384-42ff-bbf4-16d11438997b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ab442f9d-6384-42ff-bbf4-16d11438997b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:00.973431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:00.974841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:00.975640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 190/383] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:00.976286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab442f9d-6384-42ff-bbf4-16d11438997b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:00.979063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 194/384] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:00.985697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f805fed-64b9-4bbb-bd0b-a2c53303a55b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:01.135610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f805fed-64b9-4bbb-bd0b-a2c53303a55b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:01.176378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14807200-7b71-450f-9fa5-77e957ac1354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:01.177011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14807200-7b71-450f-9fa5-77e957ac1354 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:01.177329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14807200-7b71-450f-9fa5-77e957ac1354 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:01.177609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14807200-7b71-450f-9fa5-77e957ac1354 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:01.181267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14807200-7b71-450f-9fa5-77e957ac1354 None admin] RBAC: Adding query filter params (name=member) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:01.181267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14807200-7b71-450f-9fa5-77e957ac1354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:01.181267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14807200-7b71-450f-9fa5-77e957ac1354 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:01.190223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 195/385] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:01.193613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:01.196247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14807200-7b71-450f-9fa5-77e957ac1354 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:01.196640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab442f9d-6384-42ff-bbf4-16d11438997b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:01.230660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:01.278524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81977e63-717b-4c6b-87d6-0378c0397b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:01.279190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81977e63-717b-4c6b-87d6-0378c0397b3b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:01.279471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81977e63-717b-4c6b-87d6-0378c0397b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:01.279745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81977e63-717b-4c6b-87d6-0378c0397b3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:01.280532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81977e63-717b-4c6b-87d6-0378c0397b3b None admin] RBAC: Adding query filter params (group.id=e7cf23b2380a47cfa22783814b7aab50, role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=a9e60ccd9c384aa09ff28b8a6b6df44b) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:01.280844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81977e63-717b-4c6b-87d6-0378c0397b3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:01.282423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81977e63-717b-4c6b-87d6-0378c0397b3b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:01.292234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 191/386] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:12:00 2022] GET /identity/v3/role_assignments?group.id=e7cf23b2380a47cfa22783814b7aab50&scope.project.id=a9e60ccd9c384aa09ff28b8a6b6df44b&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 260 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:01.316888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14807200-7b71-450f-9fa5-77e957ac1354 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:01.340520 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81977e63-717b-4c6b-87d6-0378c0397b3b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:01.360247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9df82-2fa1-41f3-8c48-b8b15ccb3f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:01.360923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9df82-2fa1-41f3-8c48-b8b15ccb3f32 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:01.361207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9df82-2fa1-41f3-8c48-b8b15ccb3f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:01.361512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9df82-2fa1-41f3-8c48-b8b15ccb3f32 None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:01.362977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9df82-2fa1-41f3-8c48-b8b15ccb3f32 None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:01.367245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9df82-2fa1-41f3-8c48-b8b15ccb3f32 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:01.370431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 196/387] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:01 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:01.377861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9df82-2fa1-41f3-8c48-b8b15ccb3f32 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:01.532697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:01.540090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9df82-2fa1-41f3-8c48-b8b15ccb3f32 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:01.582067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81977e63-717b-4c6b-87d6-0378c0397b3b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:01.582261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508f24-c565-464c-9eed-cacaaad2e57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:01.582837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508f24-c565-464c-9eed-cacaaad2e57a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:01.583119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508f24-c565-464c-9eed-cacaaad2e57a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:01.583393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3508f24-c565-464c-9eed-cacaaad2e57a None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:01.585746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3508f24-c565-464c-9eed-cacaaad2e57a None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:01.587193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3508f24-c565-464c-9eed-cacaaad2e57a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:01.589172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 197/388] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:01 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:01.604858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508f24-c565-464c-9eed-cacaaad2e57a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:01.631713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8121-005c-4c0d-9512-8d9da562304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:01.632365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8121-005c-4c0d-9512-8d9da562304b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:01.632803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8121-005c-4c0d-9512-8d9da562304b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:01.633093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8121-005c-4c0d-9512-8d9da562304b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:01.645107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f8121-005c-4c0d-9512-8d9da562304b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-cb9f8121-005c-4c0d-9512-8d9da562304b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:01.652424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:01.653338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:01.654150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:01.656185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 192/389] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:12:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:01.661499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8121-005c-4c0d-9512-8d9da562304b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:01.697094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:01.804005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3508f24-c565-464c-9eed-cacaaad2e57a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:01.806784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8121-005c-4c0d-9512-8d9da562304b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:01.842080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b5ecc-dda1-49d4-8218-5208baa5eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:01.849258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b5ecc-dda1-49d4-8218-5208baa5eb3a None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:01.849258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b5ecc-dda1-49d4-8218-5208baa5eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:01.849258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b5ecc-dda1-49d4-8218-5208baa5eb3a None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4/groups/d024406f3bde4641aed3891df17f16e9/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:01.849258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b5ecc-dda1-49d4-8218-5208baa5eb3a None admin] RBAC: Authorizing `identity:create_grant(project_id=5039b090c00e4b52901878d5da90d9a4, group_id=d024406f3bde4641aed3891df17f16e9, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:01.849258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b5ecc-dda1-49d4-8218-5208baa5eb3a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:01.867318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31793ff-7272-433e-974c-047b529679b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:01.868230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 198/390] 10.222.0.61 () {58 vars in 1442 bytes} [Thu Sep 22 18:12:01 2022] PUT /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4/groups/d024406f3bde4641aed3891df17f16e9/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:12:01.868394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31793ff-7272-433e-974c-047b529679b3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:01.868861 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31793ff-7272-433e-974c-047b529679b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:01.869413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31793ff-7272-433e-974c-047b529679b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:01.870265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31793ff-7272-433e-974c-047b529679b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:01.870742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31793ff-7272-433e-974c-047b529679b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:01.872326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31793ff-7272-433e-974c-047b529679b3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:01.883015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 193/391] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:01.888780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b5ecc-dda1-49d4-8218-5208baa5eb3a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:01.933711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:02.047814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b5ecc-dda1-49d4-8218-5208baa5eb3a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:02.090524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753d8f8-fe2d-4cc3-a380-cb496b548290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:02.091097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753d8f8-fe2d-4cc3-a380-cb496b548290 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:02.091380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753d8f8-fe2d-4cc3-a380-cb496b548290 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:02.091657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753d8f8-fe2d-4cc3-a380-cb496b548290 None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:02.092956 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753d8f8-fe2d-4cc3-a380-cb496b548290 None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:02.094581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753d8f8-fe2d-4cc3-a380-cb496b548290 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:02.096515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 199/392] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:01 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:02.102086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31793ff-7272-433e-974c-047b529679b3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:02.235476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:02.254896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31793ff-7272-433e-974c-047b529679b3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:02.302363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613918ad-830d-4a07-958e-8e5c58e5fa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:02.303008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613918ad-830d-4a07-958e-8e5c58e5fa6b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:02.303288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613918ad-830d-4a07-958e-8e5c58e5fa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:02.303559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613918ad-830d-4a07-958e-8e5c58e5fa6b None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:02.306544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613918ad-830d-4a07-958e-8e5c58e5fa6b None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:02.308000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613918ad-830d-4a07-958e-8e5c58e5fa6b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:02.310028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 194/393] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:02 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:02.316269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753d8f8-fe2d-4cc3-a380-cb496b548290 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:02.426303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:02.437106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753d8f8-fe2d-4cc3-a380-cb496b548290 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:02.474118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a3bd-0680-429d-84ba-c0e80627a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:02.474791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a3bd-0680-429d-84ba-c0e80627a5c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:02.475075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a3bd-0680-429d-84ba-c0e80627a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:02.475353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a3bd-0680-429d-84ba-c0e80627a5c5 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4/groups/d024406f3bde4641aed3891df17f16e9/roles/3ba0b7b6bdc646f586a35aafc5c739f2` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:02.477579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2a3bd-0680-429d-84ba-c0e80627a5c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5039b090c00e4b52901878d5da90d9a4, group_id=d024406f3bde4641aed3891df17f16e9, role_id=3ba0b7b6bdc646f586a35aafc5c739f2)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:02.479033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2a3bd-0680-429d-84ba-c0e80627a5c5 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:02.495156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 200/394] 10.222.0.61 () {58 vars in 1442 bytes} [Thu Sep 22 18:12:02 2022] PUT /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4/groups/d024406f3bde4641aed3891df17f16e9/roles/3ba0b7b6bdc646f586a35aafc5c739f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:12:02.732713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2c0f-57a9-4d09-849b-9fe27a89cc28 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:02.733026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2c0f-57a9-4d09-849b-9fe27a89cc28 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:02.733338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2c0f-57a9-4d09-849b-9fe27a89cc28 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:02.734788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 195/395] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:02.740127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caacd8-1f64-45ad-864f-a29d0357d61b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:02.740411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caacd8-1f64-45ad-864f-a29d0357d61b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:02.740683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caacd8-1f64-45ad-864f-a29d0357d61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:02.762056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-32caacd8-1f64-45ad-864f-a29d0357d61b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:02.763270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-32caacd8-1f64-45ad-864f-a29d0357d61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:02.835894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 201/396] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:03.190843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6bdb6-00ef-4bc5-9d19-421daedc1deb None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:03.191385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6bdb6-00ef-4bc5-9d19-421daedc1deb None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:03.191385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6bdb6-00ef-4bc5-9d19-421daedc1deb None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:03.193093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 196/397] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:03.201959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256e5b-ce09-4026-847f-36a99cd034f2 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:03.202773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256e5b-ce09-4026-847f-36a99cd034f2 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:03.203135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256e5b-ce09-4026-847f-36a99cd034f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:03.227336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4f256e5b-ce09-4026-847f-36a99cd034f2 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:03.228556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4f256e5b-ce09-4026-847f-36a99cd034f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:03.289954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6bdb6-00ef-4bc5-9d19-421daedc1deb None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:03.327700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 202/398] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:03.419064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6bdb6-00ef-4bc5-9d19-421daedc1deb None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:03.470002 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23c62b-87aa-4b2a-9538-bec768b3ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:03.470564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23c62b-87aa-4b2a-9538-bec768b3ed74 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:03.470841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23c62b-87aa-4b2a-9538-bec768b3ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:03.471111 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23c62b-87aa-4b2a-9538-bec768b3ed74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:03.484671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23c62b-87aa-4b2a-9538-bec768b3ed74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-3e23c62b-87aa-4b2a-9538-bec768b3ed74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:03.489649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:03.490521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:03.491313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 197/399] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:12:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:03.496540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f256e5b-ce09-4026-847f-36a99cd034f2 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:03.516342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:03.615290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f256e5b-ce09-4026-847f-36a99cd034f2 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:03.652506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3291a4-5818-4650-9389-4dfd4234a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:03.653130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3291a4-5818-4650-9389-4dfd4234a01e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:03.653507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3291a4-5818-4650-9389-4dfd4234a01e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:03.653729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3291a4-5818-4650-9389-4dfd4234a01e None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:03.654432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3291a4-5818-4650-9389-4dfd4234a01e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:03.654744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3291a4-5818-4650-9389-4dfd4234a01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:03.656219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3291a4-5818-4650-9389-4dfd4234a01e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:03.664984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 203/400] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:03.670345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23c62b-87aa-4b2a-9538-bec768b3ed74 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:03.679484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3291a4-5818-4650-9389-4dfd4234a01e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:03.707161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:03.771481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:03.796399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3291a4-5818-4650-9389-4dfd4234a01e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:03.833036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a6299-69a2-49bb-a604-7dcdcfc86ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:03.833754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a6299-69a2-49bb-a604-7dcdcfc86ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:03.834037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a6299-69a2-49bb-a604-7dcdcfc86ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:03.834313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a6299-69a2-49bb-a604-7dcdcfc86ff0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:03.845474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a6299-69a2-49bb-a604-7dcdcfc86ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-175a6299-69a2-49bb-a604-7dcdcfc86ff0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:03.850917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:03.851789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:03.853002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 204/401] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:03.858030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a6299-69a2-49bb-a604-7dcdcfc86ff0 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:03.911275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23c62b-87aa-4b2a-9538-bec768b3ed74 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:04.004307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243226ba-d235-434e-84c1-4ae4c02364ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:04.005342 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243226ba-d235-434e-84c1-4ae4c02364ab None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:04.005963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243226ba-d235-434e-84c1-4ae4c02364ab None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:04.007249 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243226ba-d235-434e-84c1-4ae4c02364ab None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:04.010776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243226ba-d235-434e-84c1-4ae4c02364ab None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:04.012485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243226ba-d235-434e-84c1-4ae4c02364ab None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:04.016523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 198/402] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:03 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:04.027485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243226ba-d235-434e-84c1-4ae4c02364ab None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:04.029535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a6299-69a2-49bb-a604-7dcdcfc86ff0 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:04.123357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47541bf-48d9-4f32-9dee-639e688b28d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:04.123964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47541bf-48d9-4f32-9dee-639e688b28d6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:04.124781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47541bf-48d9-4f32-9dee-639e688b28d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:04.125052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47541bf-48d9-4f32-9dee-639e688b28d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:04.125754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47541bf-48d9-4f32-9dee-639e688b28d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:04.126059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47541bf-48d9-4f32-9dee-639e688b28d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:04.127431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47541bf-48d9-4f32-9dee-639e688b28d6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:04.129019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:04.148464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:04.151316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 205/403] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:12:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:04.156769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47541bf-48d9-4f32-9dee-639e688b28d6 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:04.171204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243226ba-d235-434e-84c1-4ae4c02364ab None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:04.209469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516113d7-06f0-4557-a72d-5f78b425ff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:04.211160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516113d7-06f0-4557-a72d-5f78b425ff69 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:04.211642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516113d7-06f0-4557-a72d-5f78b425ff69 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:04.212113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516113d7-06f0-4557-a72d-5f78b425ff69 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:04.213612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516113d7-06f0-4557-a72d-5f78b425ff69 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:04.215206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516113d7-06f0-4557-a72d-5f78b425ff69 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:04.217059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 199/404] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:04 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:04.218179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811658d-326a-4758-9c60-e0a2738e664d None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:04.218533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811658d-326a-4758-9c60-e0a2738e664d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:04.218920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811658d-326a-4758-9c60-e0a2738e664d None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:04.220409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 200/405] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:04.222473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811658d-326a-4758-9c60-e0a2738e664d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:04.300620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47541bf-48d9-4f32-9dee-639e688b28d6 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:04.354266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023fbc0-4708-4733-a46d-e6c1134ea690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:04.355469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023fbc0-4708-4733-a46d-e6c1134ea690 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:04.356329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023fbc0-4708-4733-a46d-e6c1134ea690 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:04.356329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023fbc0-4708-4733-a46d-e6c1134ea690 None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:04.357320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023fbc0-4708-4733-a46d-e6c1134ea690 None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:04.359304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023fbc0-4708-4733-a46d-e6c1134ea690 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:04.360875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 206/406] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:04 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:04.362756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541730c-f95d-4ab5-8d5c-ea9bb29b843a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:04.363223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541730c-f95d-4ab5-8d5c-ea9bb29b843a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:04.363516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541730c-f95d-4ab5-8d5c-ea9bb29b843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:04.368220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811658d-326a-4758-9c60-e0a2738e664d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:04.389920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5541730c-f95d-4ab5-8d5c-ea9bb29b843a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:04.391528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5541730c-f95d-4ab5-8d5c-ea9bb29b843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:04.410337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01178b3-5faf-4549-ad96-924302aff3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:04.411443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01178b3-5faf-4549-ad96-924302aff3b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:04.411924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01178b3-5faf-4549-ad96-924302aff3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:04.412435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01178b3-5faf-4549-ad96-924302aff3b9 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5/groups/d024406f3bde4641aed3891df17f16e9/roles/3ba0b7b6bdc646f586a35aafc5c739f2` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:04.414959 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01178b3-5faf-4549-ad96-924302aff3b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a32f116145b24d39a2550f593e4529e5, group_id=d024406f3bde4641aed3891df17f16e9, role_id=3ba0b7b6bdc646f586a35aafc5c739f2)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:04.416685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01178b3-5faf-4549-ad96-924302aff3b9 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:04.441194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 201/407] 10.222.0.61 () {58 vars in 1442 bytes} [Thu Sep 22 18:12:04 2022] PUT /identity/v3/projects/a32f116145b24d39a2550f593e4529e5/groups/d024406f3bde4641aed3891df17f16e9/roles/3ba0b7b6bdc646f586a35aafc5c739f2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:12:04.442674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01178b3-5faf-4549-ad96-924302aff3b9 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:04.465355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:04.481563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:04.510949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 207/408] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:04.595624 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01178b3-5faf-4549-ad96-924302aff3b9 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:04.637558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aad79-e975-4da5-aaa3-8203dc55eed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:04.638215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aad79-e975-4da5-aaa3-8203dc55eed3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:04.638501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aad79-e975-4da5-aaa3-8203dc55eed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:04.638776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aad79-e975-4da5-aaa3-8203dc55eed3 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:04.640035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aad79-e975-4da5-aaa3-8203dc55eed3 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:04.641896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aad79-e975-4da5-aaa3-8203dc55eed3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:04.643570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 202/409] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:04 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:04.651087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541730c-f95d-4ab5-8d5c-ea9bb29b843a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:04.772487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541730c-f95d-4ab5-8d5c-ea9bb29b843a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:04.815851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375512e-1110-47f7-b4eb-d5c29fd5d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:04.816537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375512e-1110-47f7-b4eb-d5c29fd5d745 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:04.816817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375512e-1110-47f7-b4eb-d5c29fd5d745 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:04.817091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375512e-1110-47f7-b4eb-d5c29fd5d745 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5/groups/d024406f3bde4641aed3891df17f16e9/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:04.819282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375512e-1110-47f7-b4eb-d5c29fd5d745 None admin] RBAC: Authorizing `identity:create_grant(project_id=a32f116145b24d39a2550f593e4529e5, group_id=d024406f3bde4641aed3891df17f16e9, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:04.820729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375512e-1110-47f7-b4eb-d5c29fd5d745 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:04.838816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aad79-e975-4da5-aaa3-8203dc55eed3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:04.844979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 208/410] 10.222.0.61 () {58 vars in 1442 bytes} [Thu Sep 22 18:12:04 2022] PUT /identity/v3/projects/a32f116145b24d39a2550f593e4529e5/groups/d024406f3bde4641aed3891df17f16e9/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:12:04.968092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:05.011567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aad79-e975-4da5-aaa3-8203dc55eed3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:05.062305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf2110-2141-4a4a-a71d-91c531795ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:05.062976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf2110-2141-4a4a-a71d-91c531795ecf None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.063260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf2110-2141-4a4a-a71d-91c531795ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.063533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf2110-2141-4a4a-a71d-91c531795ecf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:05.084117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf2110-2141-4a4a-a71d-91c531795ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-89cf2110-2141-4a4a-a71d-91c531795ecf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:05.090052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:05.092134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:05.094178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 203/411] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:05.101268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375512e-1110-47f7-b4eb-d5c29fd5d745 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:05.168296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:05.218652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e0f75-3b4d-4598-a9c7-8db9a1ba267d None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.219140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e0f75-3b4d-4598-a9c7-8db9a1ba267d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.219140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e0f75-3b4d-4598-a9c7-8db9a1ba267d None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:05.220466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 204/412] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:05.223313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375512e-1110-47f7-b4eb-d5c29fd5d745 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:05.228709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f345c-a735-4505-a7e1-709f43a9844f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.229140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f345c-a735-4505-a7e1-709f43a9844f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.229420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f345c-a735-4505-a7e1-709f43a9844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:05.265504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad087b-320d-4c50-8f1d-9df04864766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:05.266134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad087b-320d-4c50-8f1d-9df04864766b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.266302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-fd6f345c-a735-4505-a7e1-709f43a9844f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:05.266465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad087b-320d-4c50-8f1d-9df04864766b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.266689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad087b-320d-4c50-8f1d-9df04864766b None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:05.267437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fd6f345c-a735-4505-a7e1-709f43a9844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:05.267537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad087b-320d-4c50-8f1d-9df04864766b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:05.267780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad087b-320d-4c50-8f1d-9df04864766b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:05.269160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad087b-320d-4c50-8f1d-9df04864766b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:05.278981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 209/413] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:05.286771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad087b-320d-4c50-8f1d-9df04864766b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:05.390940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 205/414] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:05.453769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad087b-320d-4c50-8f1d-9df04864766b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:05.472317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:05.492394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbb661-d422-4ae8-8efa-0f69e3509149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:05.493469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbb661-d422-4ae8-8efa-0f69e3509149 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.494021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbb661-d422-4ae8-8efa-0f69e3509149 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.494518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbb661-d422-4ae8-8efa-0f69e3509149 None admin] PATH_INFO: `/v3/groups/e7cf23b2380a47cfa22783814b7aab50` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:05.495912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbb661-d422-4ae8-8efa-0f69e3509149 None admin] RBAC: Authorizing `identity:get_group(group_id=e7cf23b2380a47cfa22783814b7aab50)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:05.497599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbb661-d422-4ae8-8efa-0f69e3509149 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:05.504078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 210/415] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:05 2022] GET /identity/v3/groups/e7cf23b2380a47cfa22783814b7aab50 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:05.505732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f345c-a735-4505-a7e1-709f43a9844f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:05.577203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:05.583090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fb46f-d262-4570-a6ce-93dd52bbe05e None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.583443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fb46f-d262-4570-a6ce-93dd52bbe05e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.583790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fb46f-d262-4570-a6ce-93dd52bbe05e None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:05.585860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 211/416] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:05.591215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5105-dce3-401e-870c-ff43aa02c73e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.591634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5105-dce3-401e-870c-ff43aa02c73e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.592056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5105-dce3-401e-870c-ff43aa02c73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:05.622267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f94a5105-dce3-401e-870c-ff43aa02c73e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:05.623473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f94a5105-dce3-401e-870c-ff43aa02c73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:05.641287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f345c-a735-4505-a7e1-709f43a9844f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:05.679794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e29eb-d2cb-41a5-a67b-aafdc7f2acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:05.680702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e29eb-d2cb-41a5-a67b-aafdc7f2acee None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.681180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e29eb-d2cb-41a5-a67b-aafdc7f2acee None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.681688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e29eb-d2cb-41a5-a67b-aafdc7f2acee None admin] PATH_INFO: `/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:05.683086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e29eb-d2cb-41a5-a67b-aafdc7f2acee None admin] RBAC: Authorizing `identity:get_project(project_id=a9e60ccd9c384aa09ff28b8a6b6df44b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:05.684711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e29eb-d2cb-41a5-a67b-aafdc7f2acee None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:05.686612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 206/417] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:05 2022] GET /identity/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:05.692250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e29eb-d2cb-41a5-a67b-aafdc7f2acee None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:05.772755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 212/418] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:05.792375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a5105-dce3-401e-870c-ff43aa02c73e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:05.820088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e29eb-d2cb-41a5-a67b-aafdc7f2acee None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:05.862185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ddc3a-bf86-4b2c-8d30-adab65005dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:05.863651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ddc3a-bf86-4b2c-8d30-adab65005dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.864206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ddc3a-bf86-4b2c-8d30-adab65005dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.864690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ddc3a-bf86-4b2c-8d30-adab65005dc5 None admin] PATH_INFO: `/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b/groups/e7cf23b2380a47cfa22783814b7aab50/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:05.867141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ddc3a-bf86-4b2c-8d30-adab65005dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9e60ccd9c384aa09ff28b8a6b6df44b, group_id=e7cf23b2380a47cfa22783814b7aab50, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:05.869073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ddc3a-bf86-4b2c-8d30-adab65005dc5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:05.873524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:05.887100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 207/419] 10.222.0.61 () {58 vars in 1442 bytes} [Thu Sep 22 18:12:05 2022] PUT /identity/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b/groups/e7cf23b2380a47cfa22783814b7aab50/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:12:05.948424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a5105-dce3-401e-870c-ff43aa02c73e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:05.965227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:05.988124 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a767a-d105-40bf-afaf-ced702ae1c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:05.989142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a767a-d105-40bf-afaf-ced702ae1c29 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:05.989657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a767a-d105-40bf-afaf-ced702ae1c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:05.990194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a767a-d105-40bf-afaf-ced702ae1c29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:06.001922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a767a-d105-40bf-afaf-ced702ae1c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-be9a767a-d105-40bf-afaf-ced702ae1c29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:06.007175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:06.008072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:12:06.008850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:06.011617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 213/420] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:06.017953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ddc3a-bf86-4b2c-8d30-adab65005dc5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:06.102229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a767a-d105-40bf-afaf-ced702ae1c29 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:06.181325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ddc3a-bf86-4b2c-8d30-adab65005dc5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:06.221094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efa1f6-4f76-4445-b2f1-4bcd714432eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:06.221872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efa1f6-4f76-4445-b2f1-4bcd714432eb None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:06.222164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efa1f6-4f76-4445-b2f1-4bcd714432eb None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:06.222280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efa1f6-4f76-4445-b2f1-4bcd714432eb None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:06.222918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efa1f6-4f76-4445-b2f1-4bcd714432eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:06.223302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efa1f6-4f76-4445-b2f1-4bcd714432eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:06.224674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efa1f6-4f76-4445-b2f1-4bcd714432eb None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:06.236970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 208/421] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:12:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:06.243272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efa1f6-4f76-4445-b2f1-4bcd714432eb None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:06.247813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a767a-d105-40bf-afaf-ced702ae1c29 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:06.288108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6363e4e-7bbb-4f71-8ef3-f232abb3af92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:06.289096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6363e4e-7bbb-4f71-8ef3-f232abb3af92 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:06.289759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6363e4e-7bbb-4f71-8ef3-f232abb3af92 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:06.290246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6363e4e-7bbb-4f71-8ef3-f232abb3af92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:06.302453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6363e4e-7bbb-4f71-8ef3-f232abb3af92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-e6363e4e-7bbb-4f71-8ef3-f232abb3af92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:06.308167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:06.309035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:06.309852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:06.312413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 214/422] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:12:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:06.317827 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6363e4e-7bbb-4f71-8ef3-f232abb3af92 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:06.381697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:06.425620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:06.429501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6363e4e-7bbb-4f71-8ef3-f232abb3af92 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:06.468901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f16036-038e-4098-ab9d-e9d9916fe0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:06.469911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f16036-038e-4098-ab9d-e9d9916fe0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:06.470406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f16036-038e-4098-ab9d-e9d9916fe0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:06.470882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f16036-038e-4098-ab9d-e9d9916fe0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:06.471803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f16036-038e-4098-ab9d-e9d9916fe0a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:06.472303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f16036-038e-4098-ab9d-e9d9916fe0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:06.473899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f16036-038e-4098-ab9d-e9d9916fe0a8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:06.483894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 215/423] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:06.490863 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f16036-038e-4098-ab9d-e9d9916fe0a8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:06.540128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efa1f6-4f76-4445-b2f1-4bcd714432eb None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:06.598092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d45f8a-9726-4cee-a2bf-8581c915e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:06.598721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d45f8a-9726-4cee-a2bf-8581c915e888 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:06.599005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d45f8a-9726-4cee-a2bf-8581c915e888 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:06.599278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d45f8a-9726-4cee-a2bf-8581c915e888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:06.653947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:06.661787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f16036-038e-4098-ab9d-e9d9916fe0a8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:06.703662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57958ce-534e-45f1-835c-148d3a8a1a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:06.704615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57958ce-534e-45f1-835c-148d3a8a1a5f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:06.705098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57958ce-534e-45f1-835c-148d3a8a1a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:06.705635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57958ce-534e-45f1-835c-148d3a8a1a5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:06.741293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d45f8a-9726-4cee-a2bf-8581c915e888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:06.742772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d45f8a-9726-4cee-a2bf-8581c915e888 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:06.787188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57958ce-534e-45f1-835c-148d3a8a1a5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:06.789581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57958ce-534e-45f1-835c-148d3a8a1a5f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:06.872636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:06.923984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 209/424] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:06.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d45f8a-9726-4cee-a2bf-8581c915e888 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:07.020019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:07.036243 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 216/425] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:07.041637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57958ce-534e-45f1-835c-148d3a8a1a5f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:07.052355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d45f8a-9726-4cee-a2bf-8581c915e888 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:07.103416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca4b44-0cec-4c4b-9855-0b3129502653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:07.104127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca4b44-0cec-4c4b-9855-0b3129502653 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.104420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca4b44-0cec-4c4b-9855-0b3129502653 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.104703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca4b44-0cec-4c4b-9855-0b3129502653 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.105968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca4b44-0cec-4c4b-9855-0b3129502653 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:07.107410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca4b44-0cec-4c4b-9855-0b3129502653 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:07.110044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 210/426] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:06 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:07.117220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca4b44-0cec-4c4b-9855-0b3129502653 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:07.169400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:07.249270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57958ce-534e-45f1-835c-148d3a8a1a5f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:07.263654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca4b44-0cec-4c4b-9855-0b3129502653 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:07.305259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d54a1b-8476-453d-bbbc-b9eac5ff04c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:07.306848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d54a1b-8476-453d-bbbc-b9eac5ff04c5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.307421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d54a1b-8476-453d-bbbc-b9eac5ff04c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.308055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d54a1b-8476-453d-bbbc-b9eac5ff04c5 None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.310063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d54a1b-8476-453d-bbbc-b9eac5ff04c5 None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:07.311768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d54a1b-8476-453d-bbbc-b9eac5ff04c5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:07.313453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13091e57-e031-409c-8f83-a43a79438459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:07.314145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13091e57-e031-409c-8f83-a43a79438459 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.314538 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13091e57-e031-409c-8f83-a43a79438459 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.314766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 211/427] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:07 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:07.314882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13091e57-e031-409c-8f83-a43a79438459 None admin] PATH_INFO: `/v3/projects/5039b090c00e4b52901878d5da90d9a4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.316162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13091e57-e031-409c-8f83-a43a79438459 None admin] RBAC: Authorizing `identity:get_project(project_id=5039b090c00e4b52901878d5da90d9a4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:07.316435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ddbb9-3e34-460c-94aa-19a88ab12a6a None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.316917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ddbb9-3e34-460c-94aa-19a88ab12a6a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.317412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ddbb9-3e34-460c-94aa-19a88ab12a6a None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.318074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13091e57-e031-409c-8f83-a43a79438459 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:07.319459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 212/428] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:07.320392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ddbb9-3e34-460c-94aa-19a88ab12a6a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:07.322197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 217/429] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:07 2022] GET /identity/v3/projects/5039b090c00e4b52901878d5da90d9a4 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:07.327672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13091e57-e031-409c-8f83-a43a79438459 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:07.401474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:07.436657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:07.442534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13091e57-e031-409c-8f83-a43a79438459 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:07.446496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ddbb9-3e34-460c-94aa-19a88ab12a6a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:07.481150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746d503-d8b0-41a6-b6ae-5abe5f68e626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:07.481938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d503-d8b0-41a6-b6ae-5abe5f68e626 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.482289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d503-d8b0-41a6-b6ae-5abe5f68e626 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.482637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d503-d8b0-41a6-b6ae-5abe5f68e626 None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.483992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746d503-d8b0-41a6-b6ae-5abe5f68e626 None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:07.484945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101671d-93cf-4a9a-ba7a-91240ecad4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:07.485634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746d503-d8b0-41a6-b6ae-5abe5f68e626 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:07.485987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101671d-93cf-4a9a-ba7a-91240ecad4cd None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.486438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101671d-93cf-4a9a-ba7a-91240ecad4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.486880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101671d-93cf-4a9a-ba7a-91240ecad4cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.487780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101671d-93cf-4a9a-ba7a-91240ecad4cd None admin] RBAC: Adding query filter params (group.id=d024406f3bde4641aed3891df17f16e9, role.id=7c59786364c04f0087154923c39fa449, scope.project.id=5039b090c00e4b52901878d5da90d9a4) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:07.488297 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101671d-93cf-4a9a-ba7a-91240ecad4cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:07.490058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101671d-93cf-4a9a-ba7a-91240ecad4cd None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:07.492473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 218/430] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:07 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:07.493824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ffff5-9fd5-4d1d-aec1-83bc2ccf54e8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.494143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ffff5-9fd5-4d1d-aec1-83bc2ccf54e8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.494887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ffff5-9fd5-4d1d-aec1-83bc2ccf54e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.498580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 213/431] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:12:07 2022] GET /identity/v3/role_assignments?group.id=d024406f3bde4641aed3891df17f16e9&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=7c59786364c04f0087154923c39fa449 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:07.499812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101671d-93cf-4a9a-ba7a-91240ecad4cd None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:07.514460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f80ffff5-9fd5-4d1d-aec1-83bc2ccf54e8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:07.516223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f80ffff5-9fd5-4d1d-aec1-83bc2ccf54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:07.593802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 219/432] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:07.602964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73910-0fe5-4a84-b879-b5708cf933cc None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.603302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73910-0fe5-4a84-b879-b5708cf933cc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.603539 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73910-0fe5-4a84-b879-b5708cf933cc None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.605107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 220/433] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:07.611024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff3d31-c54e-4985-b0f8-0c2c4b8701da None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.611331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff3d31-c54e-4985-b0f8-0c2c4b8701da None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.611581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff3d31-c54e-4985-b0f8-0c2c4b8701da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.626486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101671d-93cf-4a9a-ba7a-91240ecad4cd None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:07.648905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-80ff3d31-c54e-4985-b0f8-0c2c4b8701da None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:07.664827 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-80ff3d31-c54e-4985-b0f8-0c2c4b8701da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:07.667117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3557-9511-48dd-be67-c275acf9028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:07.667981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3557-9511-48dd-be67-c275acf9028e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:07.668467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3557-9511-48dd-be67-c275acf9028e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:07.668983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3557-9511-48dd-be67-c275acf9028e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:07.670497 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb3557-9511-48dd-be67-c275acf9028e None admin] RBAC: Adding query filter params (group.id=d024406f3bde4641aed3891df17f16e9, role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=5039b090c00e4b52901878d5da90d9a4) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:07.671104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb3557-9511-48dd-be67-c275acf9028e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:07.675162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb3557-9511-48dd-be67-c275acf9028e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:07.682566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 214/434] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:12:07 2022] GET /identity/v3/role_assignments?group.id=d024406f3bde4641aed3891df17f16e9&scope.project.id=5039b090c00e4b52901878d5da90d9a4&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:07.754543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:07.766452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 221/435] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:07.935146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3557-9511-48dd-be67-c275acf9028e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:07.965496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:08.049712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3557-9511-48dd-be67-c275acf9028e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:08.055303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff3d31-c54e-4985-b0f8-0c2c4b8701da None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:08.099571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce63e28-e87b-4747-87a1-94f8af25d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:08.099571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63e28-e87b-4747-87a1-94f8af25d8aa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.099571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63e28-e87b-4747-87a1-94f8af25d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.099571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63e28-e87b-4747-87a1-94f8af25d8aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.113513 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce63e28-e87b-4747-87a1-94f8af25d8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-bce63e28-e87b-4747-87a1-94f8af25d8aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:08.118909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:08.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:08.120813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 215/436] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:12:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:08.127181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce63e28-e87b-4747-87a1-94f8af25d8aa None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:08.196280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff3d31-c54e-4985-b0f8-0c2c4b8701da None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:08.242886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:08.248073 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e22f6-210f-49d1-b742-2ab685ff9230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:08.248733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e22f6-210f-49d1-b742-2ab685ff9230 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.249034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e22f6-210f-49d1-b742-2ab685ff9230 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.249369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e22f6-210f-49d1-b742-2ab685ff9230 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.263303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e22f6-210f-49d1-b742-2ab685ff9230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:08.269358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce63e28-e87b-4747-87a1-94f8af25d8aa None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-087e22f6-210f-49d1-b742-2ab685ff9230 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:08.269895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:08.270778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:08.271805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 222/437] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:08.278764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e22f6-210f-49d1-b742-2ab685ff9230 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:08.321101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610de84f-fb37-470b-b9f8-c128670cc8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:08.322157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610de84f-fb37-470b-b9f8-c128670cc8ae None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.322439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610de84f-fb37-470b-b9f8-c128670cc8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.322713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610de84f-fb37-470b-b9f8-c128670cc8ae None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.323396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610de84f-fb37-470b-b9f8-c128670cc8ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:08.323700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610de84f-fb37-470b-b9f8-c128670cc8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:08.326243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610de84f-fb37-470b-b9f8-c128670cc8ae None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:08.336891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 216/438] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:08.345148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610de84f-fb37-470b-b9f8-c128670cc8ae None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:08.351867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:08.421302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e22f6-210f-49d1-b742-2ab685ff9230 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:08.458164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25be6d-84a5-4cbd-90fe-4b62ce67a7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:08.458777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25be6d-84a5-4cbd-90fe-4b62ce67a7dd None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.459052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25be6d-84a5-4cbd-90fe-4b62ce67a7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.459323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25be6d-84a5-4cbd-90fe-4b62ce67a7dd None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.459985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25be6d-84a5-4cbd-90fe-4b62ce67a7dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:08.460535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25be6d-84a5-4cbd-90fe-4b62ce67a7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:08.461933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25be6d-84a5-4cbd-90fe-4b62ce67a7dd None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:08.467858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610de84f-fb37-470b-b9f8-c128670cc8ae None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:08.470928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 223/439] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:12:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:08.472147 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622de69-4fcf-4890-bef6-cc10b1e123f9 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.472430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622de69-4fcf-4890-bef6-cc10b1e123f9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.472701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622de69-4fcf-4890-bef6-cc10b1e123f9 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.474319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 224/440] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:08.476173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622de69-4fcf-4890-bef6-cc10b1e123f9 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:08.503101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2d3fe-459c-4a85-950c-dc948ecdea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:08.503724 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d3fe-459c-4a85-950c-dc948ecdea73 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.503995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d3fe-459c-4a85-950c-dc948ecdea73 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.504264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d3fe-459c-4a85-950c-dc948ecdea73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.518893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:08.573445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2d3fe-459c-4a85-950c-dc948ecdea73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:08.574824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2d3fe-459c-4a85-950c-dc948ecdea73 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:08.579800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622de69-4fcf-4890-bef6-cc10b1e123f9 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:08.594106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:08.616199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324b053-5ee8-4d2a-888d-d58850b220d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:08.616812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324b053-5ee8-4d2a-888d-d58850b220d6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.617093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324b053-5ee8-4d2a-888d-d58850b220d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.617407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324b053-5ee8-4d2a-888d-d58850b220d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.685760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 217/441] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 18:12:08.687557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf723-8b50-4814-b290-1cce323cb7ca None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.687858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf723-8b50-4814-b290-1cce323cb7ca None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.688120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf723-8b50-4814-b290-1cce323cb7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.694822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324b053-5ee8-4d2a-888d-d58850b220d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:08.696334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324b053-5ee8-4d2a-888d-d58850b220d6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:08.706565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1b7bf723-8b50-4814-b290-1cce323cb7ca None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:08.707788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1b7bf723-8b50-4814-b290-1cce323cb7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:08.747631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:08.775472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 218/442] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:08.776307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bf723-8b50-4814-b290-1cce323cb7ca None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:08.797200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 225/443] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 18:12:08.802701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324b053-5ee8-4d2a-888d-d58850b220d6 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:08.821634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:08.888506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bf723-8b50-4814-b290-1cce323cb7ca None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:08.923618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052e214-f5fe-4071-8139-e1bfa6ac970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:08.924251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e214-f5fe-4071-8139-e1bfa6ac970e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.924353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324b053-5ee8-4d2a-888d-d58850b220d6 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:08.924532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e214-f5fe-4071-8139-e1bfa6ac970e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.924803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e214-f5fe-4071-8139-e1bfa6ac970e None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.925922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052e214-f5fe-4071-8139-e1bfa6ac970e None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:08.927345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052e214-f5fe-4071-8139-e1bfa6ac970e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:08.933461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 219/444] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:08 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:08.934356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052e214-f5fe-4071-8139-e1bfa6ac970e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:08.964184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77e8c2-bcd6-49ac-b7a9-d35f1c17f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:08.964568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e8c2-bcd6-49ac-b7a9-d35f1c17f4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:08.964848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e8c2-bcd6-49ac-b7a9-d35f1c17f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:08.965115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e8c2-bcd6-49ac-b7a9-d35f1c17f4d4 None admin] PATH_INFO: `/v3/projects/a32f116145b24d39a2550f593e4529e5` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:08.966278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77e8c2-bcd6-49ac-b7a9-d35f1c17f4d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f116145b24d39a2550f593e4529e5)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:08.967704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77e8c2-bcd6-49ac-b7a9-d35f1c17f4d4 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:08.969582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 226/445] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:08 2022] GET /identity/v3/projects/a32f116145b24d39a2550f593e4529e5 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:08.975633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77e8c2-bcd6-49ac-b7a9-d35f1c17f4d4 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:08.984813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:09.052356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052e214-f5fe-4071-8139-e1bfa6ac970e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:09.063870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:09.083196 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77e8c2-bcd6-49ac-b7a9-d35f1c17f4d4 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:09.087517 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72050e-6d6b-4050-8d2e-ae9b202226d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:09.088158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72050e-6d6b-4050-8d2e-ae9b202226d0 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:09.088439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72050e-6d6b-4050-8d2e-ae9b202226d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:09.088715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72050e-6d6b-4050-8d2e-ae9b202226d0 None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:09.089841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72050e-6d6b-4050-8d2e-ae9b202226d0 None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:09.091264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72050e-6d6b-4050-8d2e-ae9b202226d0 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:09.093165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 220/446] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:08 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:09.093796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72050e-6d6b-4050-8d2e-ae9b202226d0 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:09.122220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619133b-0376-4888-bee3-4018017ba9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:09.123022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619133b-0376-4888-bee3-4018017ba9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:09.123639 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619133b-0376-4888-bee3-4018017ba9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:09.123750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619133b-0376-4888-bee3-4018017ba9b7 None admin] PATH_INFO: `/v3/groups/d024406f3bde4641aed3891df17f16e9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:09.125586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619133b-0376-4888-bee3-4018017ba9b7 None admin] RBAC: Authorizing `identity:get_group(group_id=d024406f3bde4641aed3891df17f16e9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:09.127284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619133b-0376-4888-bee3-4018017ba9b7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:09.129055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 227/447] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:08 2022] GET /identity/v3/groups/d024406f3bde4641aed3891df17f16e9 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:09.134151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619133b-0376-4888-bee3-4018017ba9b7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:09.199039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72050e-6d6b-4050-8d2e-ae9b202226d0 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:09.209842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:09.235424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619133b-0376-4888-bee3-4018017ba9b7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:09.236255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64abab5-7fd1-4498-9435-c9e6f712c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:09.236901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64abab5-7fd1-4498-9435-c9e6f712c82a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:09.237172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64abab5-7fd1-4498-9435-c9e6f712c82a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:09.237479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64abab5-7fd1-4498-9435-c9e6f712c82a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:09.247648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64abab5-7fd1-4498-9435-c9e6f712c82a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-d64abab5-7fd1-4498-9435-c9e6f712c82a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:09.252521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:09.253429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:09.254306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 221/448] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:09.254964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64abab5-7fd1-4498-9435-c9e6f712c82a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:09.270563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a855b-67e6-4131-9f09-de79634efdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:09.271228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a855b-67e6-4131-9f09-de79634efdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:09.271441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a855b-67e6-4131-9f09-de79634efdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:09.271712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a855b-67e6-4131-9f09-de79634efdc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:09.272429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a855b-67e6-4131-9f09-de79634efdc8 None admin] RBAC: Adding query filter params (group.id=d024406f3bde4641aed3891df17f16e9, role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=a32f116145b24d39a2550f593e4529e5) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:09.272736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a855b-67e6-4131-9f09-de79634efdc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:09.274196 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a855b-67e6-4131-9f09-de79634efdc8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:09.279941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 228/449] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:12:09 2022] GET /identity/v3/role_assignments?group.id=d024406f3bde4641aed3891df17f16e9&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:09.290883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a855b-67e6-4131-9f09-de79634efdc8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:09.314366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:09.368179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64abab5-7fd1-4498-9435-c9e6f712c82a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:09.405078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8c01-8e5e-4bec-a76d-fcf09a3fd9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:09.406281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8c01-8e5e-4bec-a76d-fcf09a3fd9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:09.406562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8c01-8e5e-4bec-a76d-fcf09a3fd9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:09.406834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8c01-8e5e-4bec-a76d-fcf09a3fd9e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:09.407595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8c01-8e5e-4bec-a76d-fcf09a3fd9e8 None admin] RBAC: Adding query filter params (group.id=d024406f3bde4641aed3891df17f16e9, role.id=7c59786364c04f0087154923c39fa449, scope.project.id=a32f116145b24d39a2550f593e4529e5) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:09.407899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8c01-8e5e-4bec-a76d-fcf09a3fd9e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:09.409409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8c01-8e5e-4bec-a76d-fcf09a3fd9e8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:09.415417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a855b-67e6-4131-9f09-de79634efdc8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:09.425282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 222/450] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:12:09 2022] GET /identity/v3/role_assignments?group.id=d024406f3bde4641aed3891df17f16e9&scope.project.id=a32f116145b24d39a2550f593e4529e5&role.id=7c59786364c04f0087154923c39fa449 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:09.468282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298477-fd92-449f-a48f-fb265b3c3693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:09.468883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298477-fd92-449f-a48f-fb265b3c3693 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:09.469165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298477-fd92-449f-a48f-fb265b3c3693 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:09.469469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298477-fd92-449f-a48f-fb265b3c3693 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:09.470154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298477-fd92-449f-a48f-fb265b3c3693 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:09.470460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298477-fd92-449f-a48f-fb265b3c3693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:09.471865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298477-fd92-449f-a48f-fb265b3c3693 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:09.481778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 229/451] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:09.488406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8c01-8e5e-4bec-a76d-fcf09a3fd9e8 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:09.531364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:09.607394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8c01-8e5e-4bec-a76d-fcf09a3fd9e8 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:09.645553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fc0ed-a46f-4299-a007-2fcf7c33755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:09.646165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fc0ed-a46f-4299-a007-2fcf7c33755d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:09.646439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fc0ed-a46f-4299-a007-2fcf7c33755d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:09.646706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fc0ed-a46f-4299-a007-2fcf7c33755d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:09.728136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fc0ed-a46f-4299-a007-2fcf7c33755d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:09.729536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fc0ed-a46f-4299-a007-2fcf7c33755d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:09.763801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:09.839441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 223/452] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:09.844293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298477-fd92-449f-a48f-fb265b3c3693 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:09.931157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:09.964433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298477-fd92-449f-a48f-fb265b3c3693 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:10.001207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ff93-f21e-4ad9-a3b7-afadd519a82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:10.001796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ff93-f21e-4ad9-a3b7-afadd519a82a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:10.002082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ff93-f21e-4ad9-a3b7-afadd519a82a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:10.002357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ff93-f21e-4ad9-a3b7-afadd519a82a None admin] PATH_INFO: `/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:10.003472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909ff93-f21e-4ad9-a3b7-afadd519a82a None admin] RBAC: Authorizing `identity:get_project(project_id=a9e60ccd9c384aa09ff28b8a6b6df44b)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:10.004921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909ff93-f21e-4ad9-a3b7-afadd519a82a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:10.006573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 230/453] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:12:09 2022] GET /identity/v3/projects/a9e60ccd9c384aa09ff28b8a6b6df44b => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:10.012137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fc0ed-a46f-4299-a007-2fcf7c33755d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:10.125340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fc0ed-a46f-4299-a007-2fcf7c33755d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:10.158348 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c51dfd-7329-4e9f-a9d0-ff7eb99b5155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:10.158978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c51dfd-7329-4e9f-a9d0-ff7eb99b5155 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:10.159259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c51dfd-7329-4e9f-a9d0-ff7eb99b5155 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:10.159533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c51dfd-7329-4e9f-a9d0-ff7eb99b5155 None admin] PATH_INFO: `/v3/groups/e7cf23b2380a47cfa22783814b7aab50` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:10.160633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c51dfd-7329-4e9f-a9d0-ff7eb99b5155 None admin] RBAC: Authorizing `identity:get_group(group_id=e7cf23b2380a47cfa22783814b7aab50)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:10.162084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c51dfd-7329-4e9f-a9d0-ff7eb99b5155 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:10.163863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 224/454] 10.222.0.61 () {56 vars in 1180 bytes} [Thu Sep 22 18:12:10 2022] GET /identity/v3/groups/e7cf23b2380a47cfa22783814b7aab50 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:10.170493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ff93-f21e-4ad9-a3b7-afadd519a82a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:10.282016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ff93-f21e-4ad9-a3b7-afadd519a82a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:10.316480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3cabf-7a32-44cb-9e49-d9e3b701620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:10.317091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3cabf-7a32-44cb-9e49-d9e3b701620a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:10.317405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3cabf-7a32-44cb-9e49-d9e3b701620a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:10.317685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3cabf-7a32-44cb-9e49-d9e3b701620a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:10.318412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3cabf-7a32-44cb-9e49-d9e3b701620a None admin] RBAC: Adding query filter params (group.id=e7cf23b2380a47cfa22783814b7aab50, role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=a9e60ccd9c384aa09ff28b8a6b6df44b) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:10.318727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3cabf-7a32-44cb-9e49-d9e3b701620a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:10.320165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3cabf-7a32-44cb-9e49-d9e3b701620a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:10.325945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 231/455] 10.222.0.61 () {56 vars in 1376 bytes} [Thu Sep 22 18:12:10 2022] GET /identity/v3/role_assignments?group.id=e7cf23b2380a47cfa22783814b7aab50&scope.project.id=a9e60ccd9c384aa09ff28b8a6b6df44b&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:13.198953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6176065-d74b-4cb8-a115-82b016b9e9ca None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:13.200070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6176065-d74b-4cb8-a115-82b016b9e9ca None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:13.200546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6176065-d74b-4cb8-a115-82b016b9e9ca None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:13.202918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 225/456] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:13.208696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcf07d-c494-4bf9-aef5-2b615814db0c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:13.209598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcf07d-c494-4bf9-aef5-2b615814db0c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:13.210077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcf07d-c494-4bf9-aef5-2b615814db0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:13.234295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5dbcf07d-c494-4bf9-aef5-2b615814db0c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:13.235557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5dbcf07d-c494-4bf9-aef5-2b615814db0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:13.239735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:13.241789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c515d-476b-46fd-a7ad-d6316b158eae None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:13.242384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c515d-476b-46fd-a7ad-d6316b158eae None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:13.242854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c515d-476b-46fd-a7ad-d6316b158eae None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:13.244723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 226/457] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:13.250932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502167d5-e502-4118-bf1d-686f69708f6f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:13.251500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502167d5-e502-4118-bf1d-686f69708f6f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:13.252046 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502167d5-e502-4118-bf1d-686f69708f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:13.268989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:13.286832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-502167d5-e502-4118-bf1d-686f69708f6f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:13.288081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-502167d5-e502-4118-bf1d-686f69708f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:13.356743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 232/458] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:13.415759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 227/459] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:13.421979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470c6c7-1bb4-4b39-a122-1efe7af3a0fa None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:13.422264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470c6c7-1bb4-4b39-a122-1efe7af3a0fa None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:13.422534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470c6c7-1bb4-4b39-a122-1efe7af3a0fa None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:13.423882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 233/460] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:13.429910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503bdd-8f3c-4cd9-b2b2-48dcc7625bf8 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:13.430237 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503bdd-8f3c-4cd9-b2b2-48dcc7625bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:13.430454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503bdd-8f3c-4cd9-b2b2-48dcc7625bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:13.458563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4b503bdd-8f3c-4cd9-b2b2-48dcc7625bf8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:13.459692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4b503bdd-8f3c-4cd9-b2b2-48dcc7625bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:13.558177 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 228/461] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:13.558781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa0e0-11c4-48d3-93e3-8c4dea1af83b None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:13.559315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa0e0-11c4-48d3-93e3-8c4dea1af83b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:13.559792 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa0e0-11c4-48d3-93e3-8c4dea1af83b None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:13.561608 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 234/462] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:13.567262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb9b03-0e27-496d-b1c8-3540efb3223f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:13.567565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb9b03-0e27-496d-b1c8-3540efb3223f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:13.567812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb9b03-0e27-496d-b1c8-3540efb3223f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:13.594378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3afb9b03-0e27-496d-b1c8-3540efb3223f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:13.595571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3afb9b03-0e27-496d-b1c8-3540efb3223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:13.673514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:13.695285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 229/463] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:13.776535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fa0e0-11c4-48d3-93e3-8c4dea1af83b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:13.836547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb9b03-0e27-496d-b1c8-3540efb3223f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:13.928235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fa0e0-11c4-48d3-93e3-8c4dea1af83b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:13.964307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb9b03-0e27-496d-b1c8-3540efb3223f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:13.969869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0834-4370-4061-a83f-460b3d73ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:13.970823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0834-4370-4061-a83f-460b3d73ce7c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:13.971320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0834-4370-4061-a83f-460b3d73ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:13.971790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0834-4370-4061-a83f-460b3d73ce7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:13.980597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:13.989125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0834-4370-4061-a83f-460b3d73ce7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:13.990645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0834-4370-4061-a83f-460b3d73ce7c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-1fea0834-4370-4061-a83f-460b3d73ce7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:14.008434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:14.009428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:14.010247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:14.010247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:14.010247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:14.010247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 235/464] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:14.010247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0834-4370-4061-a83f-460b3d73ce7c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.024873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54926da-f70b-4809-af94-511fb117a12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.025807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54926da-f70b-4809-af94-511fb117a12b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.026228 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54926da-f70b-4809-af94-511fb117a12b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.027287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54926da-f70b-4809-af94-511fb117a12b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.041062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54926da-f70b-4809-af94-511fb117a12b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.042574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54926da-f70b-4809-af94-511fb117a12b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-c54926da-f70b-4809-af94-511fb117a12b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:14.058685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:14.065487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:14.066435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:14.066435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:14.066435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:14.066435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 230/465] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:14.066435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54926da-f70b-4809-af94-511fb117a12b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.115048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:14.137849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0834-4370-4061-a83f-460b3d73ce7c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:14.174293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833cfd-19bd-4193-9add-afa3191ddf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.174924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833cfd-19bd-4193-9add-afa3191ddf5c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.175203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833cfd-19bd-4193-9add-afa3191ddf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.175473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833cfd-19bd-4193-9add-afa3191ddf5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.176053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54926da-f70b-4809-af94-511fb117a12b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:14.186498 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833cfd-19bd-4193-9add-afa3191ddf5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.188001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833cfd-19bd-4193-9add-afa3191ddf5c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-ea833cfd-19bd-4193-9add-afa3191ddf5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:14.203892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:14.204988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:14.206265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:14.206265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:14.206265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:14.206265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 236/466] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:14.206265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833cfd-19bd-4193-9add-afa3191ddf5c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.215240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231dc2d-44e8-401b-b820-0003b3f6f3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.215873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231dc2d-44e8-401b-b820-0003b3f6f3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.216128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231dc2d-44e8-401b-b820-0003b3f6f3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.216400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231dc2d-44e8-401b-b820-0003b3f6f3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.217085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231dc2d-44e8-401b-b820-0003b3f6f3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:14.217415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231dc2d-44e8-401b-b820-0003b3f6f3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.219328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231dc2d-44e8-401b-b820-0003b3f6f3d6 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.237141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 231/467] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:14.238025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231dc2d-44e8-401b-b820-0003b3f6f3d6 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.263525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:14.332254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833cfd-19bd-4193-9add-afa3191ddf5c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:14.345065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231dc2d-44e8-401b-b820-0003b3f6f3d6 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:14.347710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:14.374362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f412de8-6cc5-4d45-8fd3-cbade3cbc63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.375004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f412de8-6cc5-4d45-8fd3-cbade3cbc63e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.375286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f412de8-6cc5-4d45-8fd3-cbade3cbc63e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.375638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f412de8-6cc5-4d45-8fd3-cbade3cbc63e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.382720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff93a81-e345-433e-b8f0-20bdf65c8501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.383478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff93a81-e345-433e-b8f0-20bdf65c8501 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.383657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff93a81-e345-433e-b8f0-20bdf65c8501 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.383881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff93a81-e345-433e-b8f0-20bdf65c8501 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.384529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff93a81-e345-433e-b8f0-20bdf65c8501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:14.384834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff93a81-e345-433e-b8f0-20bdf65c8501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.386323 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff93a81-e345-433e-b8f0-20bdf65c8501 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.387584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f412de8-6cc5-4d45-8fd3-cbade3cbc63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.389115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f412de8-6cc5-4d45-8fd3-cbade3cbc63e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.399721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 232/468] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:14.400952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff93a81-e345-433e-b8f0-20bdf65c8501 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-5f412de8-6cc5-4d45-8fd3-cbade3cbc63e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:14.411484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:14.412442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:14.413733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:14.413733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:14.413733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:14.413733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 237/469] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:14.418638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f412de8-6cc5-4d45-8fd3-cbade3cbc63e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.520033 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff93a81-e345-433e-b8f0-20bdf65c8501 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:14.528706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:14.536343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f412de8-6cc5-4d45-8fd3-cbade3cbc63e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:14.553618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa7f14-d839-45b6-9574-64c343138df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.554229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa7f14-d839-45b6-9574-64c343138df4 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.554505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa7f14-d839-45b6-9574-64c343138df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.554791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa7f14-d839-45b6-9574-64c343138df4 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.555404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa7f14-d839-45b6-9574-64c343138df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:14.555703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa7f14-d839-45b6-9574-64c343138df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.557070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa7f14-d839-45b6-9574-64c343138df4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.570829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 233/470] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:14.570999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498bef0-8179-4223-acaa-a78fbd237199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.571444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498bef0-8179-4223-acaa-a78fbd237199 None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.571721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498bef0-8179-4223-acaa-a78fbd237199 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.571920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa7f14-d839-45b6-9574-64c343138df4 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.572059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498bef0-8179-4223-acaa-a78fbd237199 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.572715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498bef0-8179-4223-acaa-a78fbd237199 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.574184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498bef0-8179-4223-acaa-a78fbd237199 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.596309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 238/471] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:12:14 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:12:14.597056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498bef0-8179-4223-acaa-a78fbd237199 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.607154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:14.696143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa7f14-d839-45b6-9574-64c343138df4 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:14.732736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498bef0-8179-4223-acaa-a78fbd237199 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:14.733952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c5f1c-1d7b-49cd-b9e3-410ce174dd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.734921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c5f1c-1d7b-49cd-b9e3-410ce174dd32 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.736254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c5f1c-1d7b-49cd-b9e3-410ce174dd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.736653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c5f1c-1d7b-49cd-b9e3-410ce174dd32 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.737539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c5f1c-1d7b-49cd-b9e3-410ce174dd32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.739181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c5f1c-1d7b-49cd-b9e3-410ce174dd32 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.773268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 234/472] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:12:14 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:12:14.773268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43526462-6dbd-457d-933a-588ca460afca None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.773268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43526462-6dbd-457d-933a-588ca460afca None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.773268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43526462-6dbd-457d-933a-588ca460afca None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.773268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 235/473] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:14.773268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43526462-6dbd-457d-933a-588ca460afca None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.784039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c1481-c84f-486b-876b-00d03c8dc8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.784869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c1481-c84f-486b-876b-00d03c8dc8ea None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.785223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c1481-c84f-486b-876b-00d03c8dc8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.785642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c1481-c84f-486b-876b-00d03c8dc8ea None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.786335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c1481-c84f-486b-876b-00d03c8dc8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:14.786649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c1481-c84f-486b-876b-00d03c8dc8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.788070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c1481-c84f-486b-876b-00d03c8dc8ea None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:14.802549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 239/474] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:14.803646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06d4d3-c274-4a91-9df8-6b39fff63501 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.803933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06d4d3-c274-4a91-9df8-6b39fff63501 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.804209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06d4d3-c274-4a91-9df8-6b39fff63501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.828183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-fd06d4d3-c274-4a91-9df8-6b39fff63501 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:14.829340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-fd06d4d3-c274-4a91-9df8-6b39fff63501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:14.832725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:14.892634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:14.923344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43526462-6dbd-457d-933a-588ca460afca None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:14.934726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 240/475] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:14.935939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06d4d3-c274-4a91-9df8-6b39fff63501 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:14.978028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff087b3-c13b-4f8f-847f-54a2c24264e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:14.978658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff087b3-c13b-4f8f-847f-54a2c24264e5 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:14.978946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff087b3-c13b-4f8f-847f-54a2c24264e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:14.979233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff087b3-c13b-4f8f-847f-54a2c24264e5 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:14.980002 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff087b3-c13b-4f8f-847f-54a2c24264e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:14.981472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff087b3-c13b-4f8f-847f-54a2c24264e5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:15.011044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 236/476] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:12:14 2022] POST /identity/v3/users => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:12:15.070881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06d4d3-c274-4a91-9df8-6b39fff63501 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:15.115344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917f1fc-eab5-4ece-9fd7-b222c92821a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:15.116323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917f1fc-eab5-4ece-9fd7-b222c92821a8 None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:15.116788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917f1fc-eab5-4ece-9fd7-b222c92821a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:15.117329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917f1fc-eab5-4ece-9fd7-b222c92821a8 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:15.118219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917f1fc-eab5-4ece-9fd7-b222c92821a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:15.119967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917f1fc-eab5-4ece-9fd7-b222c92821a8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:15.132664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:15.149397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 241/477] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:12:14 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:12:15.258483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff087b3-c13b-4f8f-847f-54a2c24264e5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:15.379728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff087b3-c13b-4f8f-847f-54a2c24264e5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:15.415338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:15.415868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:15.416142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:15.416418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:15.417082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:15.418489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:15.424164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:15.431031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.sql.core [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 18:12:15.431031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 18:12:15.431031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [parameters: {'id': '39e1b1cb604b447ba91695e760ecd33e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 18:12:15.431031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81343) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application conn.query(q) Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application result.read() Sep 22 18:12:15.452923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return ref.to_dict() Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 18:12:15.453884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application next(self.gen) Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application yield resource Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application next(self.gen) Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise self.value Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application session.commit() Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 18:12:15.454774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self.session.flush() Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application compat.raise_( Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 18:12:15.455620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 18:12:15.456478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application conn.query(q) Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application result.read() Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 18:12:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [parameters: {'id': '39e1b1cb604b447ba91695e760ecd33e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:15.458095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 18:12:15.458876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:15.462297 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 237/478] 10.222.0.61 () {60 vars in 1131 bytes} [Thu Sep 22 18:12:15 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:15.462421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917f1fc-eab5-4ece-9fd7-b222c92821a8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:15.583145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917f1fc-eab5-4ece-9fd7-b222c92821a8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:15.629401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7e34f-6747-4f57-b0ef-e64aa491a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:15.630053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7e34f-6747-4f57-b0ef-e64aa491a294 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:15.630336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7e34f-6747-4f57-b0ef-e64aa491a294 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:15.630612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7e34f-6747-4f57-b0ef-e64aa491a294 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:15.654976 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7e34f-6747-4f57-b0ef-e64aa491a294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-26b7e34f-6747-4f57-b0ef-e64aa491a294 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:15.663668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:15.665881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:15.668155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 242/479] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:12:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:15.669777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:15.845080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccbecc-bbe4-4363-9749-3534c6782074 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:15.890355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ef61c-bf6f-4de0-9962-4b08e9777ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:15.890981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ef61c-bf6f-4de0-9962-4b08e9777ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:15.891266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ef61c-bf6f-4de0-9962-4b08e9777ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:15.891597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ef61c-bf6f-4de0-9962-4b08e9777ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:15.892286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ef61c-bf6f-4de0-9962-4b08e9777ff6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:15.892593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ef61c-bf6f-4de0-9962-4b08e9777ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:15.894117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ef61c-bf6f-4de0-9962-4b08e9777ff6 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:15.909749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 238/480] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:17.535696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a45b81-0289-46dc-aa4a-262d4e18d8e6 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:17.536207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a45b81-0289-46dc-aa4a-262d4e18d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:17.536282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a45b81-0289-46dc-aa4a-262d4e18d8e6 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:17.537754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 243/481] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:17.543488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deea9f-748d-4933-ae24-47ff6e6307ee None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:17.543979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deea9f-748d-4933-ae24-47ff6e6307ee None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:17.544055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deea9f-748d-4933-ae24-47ff6e6307ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:17.574345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-70deea9f-748d-4933-ae24-47ff6e6307ee None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:17.575574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-70deea9f-748d-4933-ae24-47ff6e6307ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:17.601690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e13f-fb69-4562-8ff2-6508f5fbbf87 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:17.601980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e13f-fb69-4562-8ff2-6508f5fbbf87 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:17.602240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e13f-fb69-4562-8ff2-6508f5fbbf87 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:17.603861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 244/482] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:17.609681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0901f-0887-4ecb-aa25-25158e6b489c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:17.609973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0901f-0887-4ecb-aa25-25158e6b489c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:17.610247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0901f-0887-4ecb-aa25-25158e6b489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:17.651093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-94b0901f-0887-4ecb-aa25-25158e6b489c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:17.652982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-94b0901f-0887-4ecb-aa25-25158e6b489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:17.654474 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:17.678587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 239/483] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:17.739754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:17.765252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 245/484] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:17.924880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554b4d-dc23-43c2-be04-d15ff9c31a34 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:17.925190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554b4d-dc23-43c2-be04-d15ff9c31a34 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:17.925472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554b4d-dc23-43c2-be04-d15ff9c31a34 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:17.927143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 240/485] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:17.932343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3135068-665e-4fcc-aa2d-6fe4763114e8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:17.932706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3135068-665e-4fcc-aa2d-6fe4763114e8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:17.932991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3135068-665e-4fcc-aa2d-6fe4763114e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:17.955988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c3135068-665e-4fcc-aa2d-6fe4763114e8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:17.957197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c3135068-665e-4fcc-aa2d-6fe4763114e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:18.043790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 246/486] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:18.047626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74966b0-dabb-408a-a396-d6bc41d0fb09 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:18.047918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74966b0-dabb-408a-a396-d6bc41d0fb09 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:18.048197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74966b0-dabb-408a-a396-d6bc41d0fb09 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:18.049838 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 241/487] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:18.057853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633469f-dd2b-4425-880b-7f3f1a7c43f9 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:18.058288 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633469f-dd2b-4425-880b-7f3f1a7c43f9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:18.058704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633469f-dd2b-4425-880b-7f3f1a7c43f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:18.085494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d633469f-dd2b-4425-880b-7f3f1a7c43f9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:18.086992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d633469f-dd2b-4425-880b-7f3f1a7c43f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:18.146996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74966b0-dabb-408a-a396-d6bc41d0fb09 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:18.216659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 247/488] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:18.218417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633469f-dd2b-4425-880b-7f3f1a7c43f9 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:18.306519 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:18.381292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74966b0-dabb-408a-a396-d6bc41d0fb09 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:18.395677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633469f-dd2b-4425-880b-7f3f1a7c43f9 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:18.433183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c6f68-43c5-4302-9238-076f9f32a4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:18.433678 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73356951-378c-4cb4-8301-c7ce8c31e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:18.433892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c6f68-43c5-4302-9238-076f9f32a4be None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:18.434149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c6f68-43c5-4302-9238-076f9f32a4be None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:18.434317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73356951-378c-4cb4-8301-c7ce8c31e6cc None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:18.434407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c6f68-43c5-4302-9238-076f9f32a4be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:18.434600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73356951-378c-4cb4-8301-c7ce8c31e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:18.434912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73356951-378c-4cb4-8301-c7ce8c31e6cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:18.451968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73356951-378c-4cb4-8301-c7ce8c31e6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:18.453868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c6f68-43c5-4302-9238-076f9f32a4be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-73356951-378c-4cb4-8301-c7ce8c31e6cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:18.457208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:18.458098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:18.459446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 248/489] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:18.460117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73356951-378c-4cb4-8301-c7ce8c31e6cc None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-637c6f68-43c5-4302-9238-076f9f32a4be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:18.462849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:18.464122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:18.464915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:18.467047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 242/490] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:18.468323 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c6f68-43c5-4302-9238-076f9f32a4be None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:18.584622 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:18.610050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73356951-378c-4cb4-8301-c7ce8c31e6cc None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:18.618533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:18.655079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c6f68-43c5-4302-9238-076f9f32a4be None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:18.656963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aa5b7-aae6-4ab3-bf89-d6219a529931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:18.657927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aa5b7-aae6-4ab3-bf89-d6219a529931 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:18.658381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aa5b7-aae6-4ab3-bf89-d6219a529931 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:18.658701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aa5b7-aae6-4ab3-bf89-d6219a529931 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:18.675584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915aa5b7-aae6-4ab3-bf89-d6219a529931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-915aa5b7-aae6-4ab3-bf89-d6219a529931 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:18.680951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:18.682566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:18.684129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:18.687520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 249/491] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:18.688721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aa5b7-aae6-4ab3-bf89-d6219a529931 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:18.704628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117005d7-4f06-4892-a9d9-1a9b0ec18d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:18.705286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117005d7-4f06-4892-a9d9-1a9b0ec18d68 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:18.705585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117005d7-4f06-4892-a9d9-1a9b0ec18d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:18.705864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117005d7-4f06-4892-a9d9-1a9b0ec18d68 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:18.706546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117005d7-4f06-4892-a9d9-1a9b0ec18d68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:18.706849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117005d7-4f06-4892-a9d9-1a9b0ec18d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:18.708236 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117005d7-4f06-4892-a9d9-1a9b0ec18d68 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:18.717917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 243/492] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:18.718930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117005d7-4f06-4892-a9d9-1a9b0ec18d68 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:18.838971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aa5b7-aae6-4ab3-bf89-d6219a529931 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:18.869427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117005d7-4f06-4892-a9d9-1a9b0ec18d68 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:18.887361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:18.888729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac55ea-7463-449e-87d4-f24566efdddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:18.890729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac55ea-7463-449e-87d4-f24566efdddb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:18.891298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac55ea-7463-449e-87d4-f24566efdddb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:18.892957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac55ea-7463-449e-87d4-f24566efdddb None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:18.892957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac55ea-7463-449e-87d4-f24566efdddb None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:18.893346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac55ea-7463-449e-87d4-f24566efdddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:18.895251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac55ea-7463-449e-87d4-f24566efdddb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:18.909293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 250/493] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:18.909293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac55ea-7463-449e-87d4-f24566efdddb None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:18.922488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076309e2-9e00-4eff-8151-e86ba77a6480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:18.923443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076309e2-9e00-4eff-8151-e86ba77a6480 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:18.923882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076309e2-9e00-4eff-8151-e86ba77a6480 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:18.924326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076309e2-9e00-4eff-8151-e86ba77a6480 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:18.938731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:18.940623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076309e2-9e00-4eff-8151-e86ba77a6480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-076309e2-9e00-4eff-8151-e86ba77a6480 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:18.950061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:18.950980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:18.951789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:18.957740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 244/494] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:18.957740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076309e2-9e00-4eff-8151-e86ba77a6480 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.027358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac55ea-7463-449e-87d4-f24566efdddb None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.063789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceee5f-6557-40b4-9cda-f58da935e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.064415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceee5f-6557-40b4-9cda-f58da935e0cd None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.064696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceee5f-6557-40b4-9cda-f58da935e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.064971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceee5f-6557-40b4-9cda-f58da935e0cd None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.065670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceee5f-6557-40b4-9cda-f58da935e0cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:19.065975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceee5f-6557-40b4-9cda-f58da935e0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:19.067351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceee5f-6557-40b4-9cda-f58da935e0cd None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:19.075526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 251/495] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:19.076320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceee5f-6557-40b4-9cda-f58da935e0cd None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.076576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076309e2-9e00-4eff-8151-e86ba77a6480 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.127904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd5977-e6ae-475b-a3a3-77d14723c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.128542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd5977-e6ae-475b-a3a3-77d14723c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.128821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd5977-e6ae-475b-a3a3-77d14723c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.129093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd5977-e6ae-475b-a3a3-77d14723c6e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.140423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd5977-e6ae-475b-a3a3-77d14723c6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:19.142005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd5977-e6ae-475b-a3a3-77d14723c6e7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-a3dd5977-e6ae-475b-a3a3-77d14723c6e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:19.161949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:19.162919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:19.163878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:19.163878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:19.163878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:19.163878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 245/496] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:19.163878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd5977-e6ae-475b-a3a3-77d14723c6e7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.179087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:19.191173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceee5f-6557-40b4-9cda-f58da935e0cd None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.196541 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:19.226456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a7da1-2a86-4618-a311-4db802efbe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.227107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a7da1-2a86-4618-a311-4db802efbe19 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.227393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a7da1-2a86-4618-a311-4db802efbe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.227673 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a7da1-2a86-4618-a311-4db802efbe19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.239137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a7da1-2a86-4618-a311-4db802efbe19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:19.240610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a7da1-2a86-4618-a311-4db802efbe19 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-3a3a7da1-2a86-4618-a311-4db802efbe19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:19.255908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:19.257535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:19.258751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:19.258751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:19.258751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:19.258751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 252/497] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:19.258751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e670c-ed75-4e94-9c38-79f61c71e376 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.259128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e670c-ed75-4e94-9c38-79f61c71e376 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.259128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e670c-ed75-4e94-9c38-79f61c71e376 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.260309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 253/498] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:19.261005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e670c-ed75-4e94-9c38-79f61c71e376 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.281994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd5977-e6ae-475b-a3a3-77d14723c6e7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.325830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c4a37-1536-448d-9225-0d40eb619416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.326819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c4a37-1536-448d-9225-0d40eb619416 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.328005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c4a37-1536-448d-9225-0d40eb619416 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.328592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c4a37-1536-448d-9225-0d40eb619416 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.328992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c4a37-1536-448d-9225-0d40eb619416 None admin] RBAC: Adding query filter params (name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:19.329809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c4a37-1536-448d-9225-0d40eb619416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:19.333547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c4a37-1536-448d-9225-0d40eb619416 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:19.340915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 246/499] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:19.341788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c4a37-1536-448d-9225-0d40eb619416 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.373050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e670c-ed75-4e94-9c38-79f61c71e376 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.408738 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f91c-aa6c-487b-acf4-9ae89bda6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.409361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f91c-aa6c-487b-acf4-9ae89bda6a24 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.409645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f91c-aa6c-487b-acf4-9ae89bda6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.409922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f91c-aa6c-487b-acf4-9ae89bda6a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.425984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07f91c-aa6c-487b-acf4-9ae89bda6a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:19.428102 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07f91c-aa6c-487b-acf4-9ae89bda6a24 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:19.431052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-3a07f91c-aa6c-487b-acf4-9ae89bda6a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:19.447615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:19.448553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:19.449402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:19.449402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:19.449402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:19.449402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 254/500] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:19.449662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f91c-aa6c-487b-acf4-9ae89bda6a24 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.450454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:19.468226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c4a37-1536-448d-9225-0d40eb619416 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.508066 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32b409-75d2-495b-90eb-26bf7de594e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.508684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32b409-75d2-495b-90eb-26bf7de594e5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.508963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32b409-75d2-495b-90eb-26bf7de594e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.509255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32b409-75d2-495b-90eb-26bf7de594e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.509906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32b409-75d2-495b-90eb-26bf7de594e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:19.510209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32b409-75d2-495b-90eb-26bf7de594e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:19.511574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32b409-75d2-495b-90eb-26bf7de594e5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:19.524252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 247/501] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:19.525662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21933cf2-98f5-4bf4-a0ad-0b94980ae6b3 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.525956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21933cf2-98f5-4bf4-a0ad-0b94980ae6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.526231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21933cf2-98f5-4bf4-a0ad-0b94980ae6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.544309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-21933cf2-98f5-4bf4-a0ad-0b94980ae6b3 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:19.545469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-21933cf2-98f5-4bf4-a0ad-0b94980ae6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:19.567160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f91c-aa6c-487b-acf4-9ae89bda6a24 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.614026 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b656-1942-420e-9826-8fcbedaa8241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.614710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b656-1942-420e-9826-8fcbedaa8241 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.614912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b656-1942-420e-9826-8fcbedaa8241 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.615192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b656-1942-420e-9826-8fcbedaa8241 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.615841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41b656-1942-420e-9826-8fcbedaa8241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:19.616154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41b656-1942-420e-9826-8fcbedaa8241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:19.617553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41b656-1942-420e-9826-8fcbedaa8241 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:19.627721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 248/502] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:19.628636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21933cf2-98f5-4bf4-a0ad-0b94980ae6b3 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.633731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 255/503] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:19.634626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b656-1942-420e-9826-8fcbedaa8241 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.699745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:19.737655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:19.768141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b656-1942-420e-9826-8fcbedaa8241 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.777225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21933cf2-98f5-4bf4-a0ad-0b94980ae6b3 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.806602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7040e4-9d17-453f-8b7a-5b821bd19af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.807140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7040e4-9d17-453f-8b7a-5b821bd19af4 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.807425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7040e4-9d17-453f-8b7a-5b821bd19af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.807699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7040e4-9d17-453f-8b7a-5b821bd19af4 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.808347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7040e4-9d17-453f-8b7a-5b821bd19af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:19.808665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7040e4-9d17-453f-8b7a-5b821bd19af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:19.810061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7040e4-9d17-453f-8b7a-5b821bd19af4 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:19.821734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 256/504] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:19.822457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7040e4-9d17-453f-8b7a-5b821bd19af4 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.823721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdf946-fee0-4eae-9c42-ab8710ce1de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.824599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdf946-fee0-4eae-9c42-ab8710ce1de1 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.825313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdf946-fee0-4eae-9c42-ab8710ce1de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.826705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdf946-fee0-4eae-9c42-ab8710ce1de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:19.839485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdf946-fee0-4eae-9c42-ab8710ce1de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:19.840968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdf946-fee0-4eae-9c42-ab8710ce1de1 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-2acdf946-fee0-4eae-9c42-ab8710ce1de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:19.859892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:19.860948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:19.861831 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:19.861831 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:19.861831 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:19.861831 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 249/505] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:19.862111 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdf946-fee0-4eae-9c42-ab8710ce1de1 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:19.941688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7040e4-9d17-453f-8b7a-5b821bd19af4 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.962810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:19.985678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdf946-fee0-4eae-9c42-ab8710ce1de1 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:19.988884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea454d9b-b44f-4efe-894f-c22e6953e2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:19.989645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea454d9b-b44f-4efe-894f-c22e6953e2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:19.989930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea454d9b-b44f-4efe-894f-c22e6953e2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:19.990203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea454d9b-b44f-4efe-894f-c22e6953e2a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.003249 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea454d9b-b44f-4efe-894f-c22e6953e2a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.005431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea454d9b-b44f-4efe-894f-c22e6953e2a7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-ea454d9b-b44f-4efe-894f-c22e6953e2a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:20.026682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:20.027880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:20.028828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 257/506] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:20.029761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea454d9b-b44f-4efe-894f-c22e6953e2a7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.030271 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:20.039067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750a99b-edb2-487f-80be-ab684b669ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.039743 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750a99b-edb2-487f-80be-ab684b669ced None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.040030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750a99b-edb2-487f-80be-ab684b669ced None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.040306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750a99b-edb2-487f-80be-ab684b669ced None admin] PATH_INFO: `/v3/users/glance` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.049318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750a99b-edb2-487f-80be-ab684b669ced None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.050782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750a99b-edb2-487f-80be-ab684b669ced None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-5750a99b-edb2-487f-80be-ab684b669ced None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:20.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:20.072579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 250/507] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:20.074069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750a99b-edb2-487f-80be-ab684b669ced None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.137629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea454d9b-b44f-4efe-894f-c22e6953e2a7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.175610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cebe2a-710f-4b5d-ad45-fd67cb377394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.176207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cebe2a-710f-4b5d-ad45-fd67cb377394 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.176495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cebe2a-710f-4b5d-ad45-fd67cb377394 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.176829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cebe2a-710f-4b5d-ad45-fd67cb377394 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.181795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750a99b-edb2-487f-80be-ab684b669ced None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.186466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cebe2a-710f-4b5d-ad45-fd67cb377394 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.187966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cebe2a-710f-4b5d-ad45-fd67cb377394 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-13cebe2a-710f-4b5d-ad45-fd67cb377394 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:20.212592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:20.213883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:20.214788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 258/508] 10.222.0.61 () {56 vars in 1093 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:20.216061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cebe2a-710f-4b5d-ad45-fd67cb377394 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.223152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41878a42-bc13-426c-bfd3-720c258934bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.224204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41878a42-bc13-426c-bfd3-720c258934bf None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.224710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41878a42-bc13-426c-bfd3-720c258934bf None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.225206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41878a42-bc13-426c-bfd3-720c258934bf None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.226440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41878a42-bc13-426c-bfd3-720c258934bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:20.227003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41878a42-bc13-426c-bfd3-720c258934bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.229636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41878a42-bc13-426c-bfd3-720c258934bf None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.244399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 251/509] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:20.245251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41878a42-bc13-426c-bfd3-720c258934bf None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.271793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:20.306448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:20.355178 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cebe2a-710f-4b5d-ad45-fd67cb377394 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.370133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41878a42-bc13-426c-bfd3-720c258934bf None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.390933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df26f10-22bf-423c-884d-0a66579758b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.391578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26f10-22bf-423c-884d-0a66579758b3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.391858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26f10-22bf-423c-884d-0a66579758b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.392133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26f10-22bf-423c-884d-0a66579758b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.402994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df26f10-22bf-423c-884d-0a66579758b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.404649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df26f10-22bf-423c-884d-0a66579758b3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.418912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39104bd-a457-43e0-946a-fe566bb3b77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.419721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39104bd-a457-43e0-946a-fe566bb3b77b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-9df26f10-22bf-423c-884d-0a66579758b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:20.420011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:20.421882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:20.423156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:20.423156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:20.423156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:20.423417 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39104bd-a457-43e0-946a-fe566bb3b77b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.423417 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39104bd-a457-43e0-946a-fe566bb3b77b None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.423603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 259/510] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:20.423603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df26f10-22bf-423c-884d-0a66579758b3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.428531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39104bd-a457-43e0-946a-fe566bb3b77b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:20.429081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39104bd-a457-43e0-946a-fe566bb3b77b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.431393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39104bd-a457-43e0-946a-fe566bb3b77b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.481347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 252/511] 10.222.0.61 () {56 vars in 1137 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:20.482188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39104bd-a457-43e0-946a-fe566bb3b77b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.517595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:20.539892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df26f10-22bf-423c-884d-0a66579758b3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.579858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc257-9498-40af-a6df-4b14dad7b0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.580606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc257-9498-40af-a6df-4b14dad7b0fc None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.580948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc257-9498-40af-a6df-4b14dad7b0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.581335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc257-9498-40af-a6df-4b14dad7b0fc None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.582382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc257-9498-40af-a6df-4b14dad7b0fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:20.582817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc257-9498-40af-a6df-4b14dad7b0fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.584386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc257-9498-40af-a6df-4b14dad7b0fc None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.602242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39104bd-a457-43e0-946a-fe566bb3b77b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.613903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:20.636265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 260/512] 10.222.0.61 () {56 vars in 1137 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:20.637671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc257-9498-40af-a6df-4b14dad7b0fc None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.657908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798e8b1-dcbd-4e9f-b193-f7033c3eba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.658870 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798e8b1-dcbd-4e9f-b193-f7033c3eba19 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.659029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798e8b1-dcbd-4e9f-b193-f7033c3eba19 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.659317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798e8b1-dcbd-4e9f-b193-f7033c3eba19 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.660079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798e8b1-dcbd-4e9f-b193-f7033c3eba19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:20.660386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798e8b1-dcbd-4e9f-b193-f7033c3eba19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.661873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798e8b1-dcbd-4e9f-b193-f7033c3eba19 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.684842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 253/513] 10.222.0.61 () {56 vars in 1133 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:20.685964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798e8b1-dcbd-4e9f-b193-f7033c3eba19 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.785584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798e8b1-dcbd-4e9f-b193-f7033c3eba19 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.789510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc257-9498-40af-a6df-4b14dad7b0fc None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.819343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a63c-38e1-48df-ae9f-638a6dcca1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.819945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a63c-38e1-48df-ae9f-638a6dcca1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.820226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a63c-38e1-48df-ae9f-638a6dcca1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.820503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a63c-38e1-48df-ae9f-638a6dcca1b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.821148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114a63c-38e1-48df-ae9f-638a6dcca1b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:20.821481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114a63c-38e1-48df-ae9f-638a6dcca1b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.822850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114a63c-38e1-48df-ae9f-638a6dcca1b8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.825346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d946e-825c-48f3-b0df-a0ffd71e9b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.825983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d946e-825c-48f3-b0df-a0ffd71e9b09 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.826266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d946e-825c-48f3-b0df-a0ffd71e9b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.826543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d946e-825c-48f3-b0df-a0ffd71e9b09 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.834410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 254/514] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:20.834569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d946e-825c-48f3-b0df-a0ffd71e9b09 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:20.835202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a63c-38e1-48df-ae9f-638a6dcca1b8 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.836383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d946e-825c-48f3-b0df-a0ffd71e9b09 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-f08d946e-825c-48f3-b0df-a0ffd71e9b09 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:20.850580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:20.851952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 261/515] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:20.853180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d946e-825c-48f3-b0df-a0ffd71e9b09 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:20.856281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:20.869175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:20.942623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a63c-38e1-48df-ae9f-638a6dcca1b8 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.953146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d946e-825c-48f3-b0df-a0ffd71e9b09 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:20.976207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4724e07-40d9-4434-aaca-19e3cb6223d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.976847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4724e07-40d9-4434-aaca-19e3cb6223d3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.977127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4724e07-40d9-4434-aaca-19e3cb6223d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.977426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4724e07-40d9-4434-aaca-19e3cb6223d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:20.986958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fbc61-c381-4946-9dec-a0a32e2d44b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:20.987566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fbc61-c381-4946-9dec-a0a32e2d44b2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:20.987852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fbc61-c381-4946-9dec-a0a32e2d44b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:20.988138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fbc61-c381-4946-9dec-a0a32e2d44b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:21.043885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4724e07-40d9-4434-aaca-19e3cb6223d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:21.045376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4724e07-40d9-4434-aaca-19e3cb6223d3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:21.059336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fbc61-c381-4946-9dec-a0a32e2d44b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:21.060875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fbc61-c381-4946-9dec-a0a32e2d44b2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:21.064215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:21.074663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:21.149533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 255/516] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:21.150292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4724e07-40d9-4434-aaca-19e3cb6223d3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:21.167209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 262/517] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:21.168164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fbc61-c381-4946-9dec-a0a32e2d44b2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:21.268865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fbc61-c381-4946-9dec-a0a32e2d44b2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:21.272297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:21.276964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4724e07-40d9-4434-aaca-19e3cb6223d3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:21.304360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:21.308726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97020995-510f-4320-a85f-ad05faccf41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:21.309492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97020995-510f-4320-a85f-ad05faccf41d None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:21.309775 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97020995-510f-4320-a85f-ad05faccf41d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:21.310050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97020995-510f-4320-a85f-ad05faccf41d None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:21.310714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97020995-510f-4320-a85f-ad05faccf41d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:21.312218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97020995-510f-4320-a85f-ad05faccf41d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:21.313637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887839d8-ab27-4d57-a954-dd5e0fc08a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:21.314234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887839d8-ab27-4d57-a954-dd5e0fc08a7a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:21.314511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887839d8-ab27-4d57-a954-dd5e0fc08a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:21.314779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887839d8-ab27-4d57-a954-dd5e0fc08a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:21.345270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 263/518] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:12:21 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:12:21.345270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97020995-510f-4320-a85f-ad05faccf41d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:21.396560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887839d8-ab27-4d57-a954-dd5e0fc08a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:21.398443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887839d8-ab27-4d57-a954-dd5e0fc08a7a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:21.459377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97020995-510f-4320-a85f-ad05faccf41d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:21.506959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08fa27-d520-48b8-9446-bd740fee1eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:21.507671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08fa27-d520-48b8-9446-bd740fee1eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:21.508007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08fa27-d520-48b8-9446-bd740fee1eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:21.508337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08fa27-d520-48b8-9446-bd740fee1eb5 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:21.509133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08fa27-d520-48b8-9446-bd740fee1eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:21.509550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08fa27-d520-48b8-9446-bd740fee1eb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:21.511160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08fa27-d520-48b8-9446-bd740fee1eb5 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:21.524909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 256/519] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:21.529368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887839d8-ab27-4d57-a954-dd5e0fc08a7a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:21.530835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 264/520] 10.222.0.61 () {56 vars in 1139 bytes} [Thu Sep 22 18:12:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:21.533582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08fa27-d520-48b8-9446-bd740fee1eb5 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:21.561876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:21.565557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:21.649317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887839d8-ab27-4d57-a954-dd5e0fc08a7a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:21.658494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08fa27-d520-48b8-9446-bd740fee1eb5 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:21.694303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7cbf-ed64-4f91-adc5-770d0634b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:21.694945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7cbf-ed64-4f91-adc5-770d0634b6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:21.695229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7cbf-ed64-4f91-adc5-770d0634b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:21.695504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7cbf-ed64-4f91-adc5-770d0634b6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:21.700797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e29bd9-6a7f-4be3-a252-a87c7fc542e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:21.701671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e29bd9-6a7f-4be3-a252-a87c7fc542e2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:21.702099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e29bd9-6a7f-4be3-a252-a87c7fc542e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:21.702549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e29bd9-6a7f-4be3-a252-a87c7fc542e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:21.706384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7cbf-ed64-4f91-adc5-770d0634b6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:21.707974 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7cbf-ed64-4f91-adc5-770d0634b6e0 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:21.715181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e29bd9-6a7f-4be3-a252-a87c7fc542e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:21.717372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e29bd9-6a7f-4be3-a252-a87c7fc542e2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-d14d7cbf-ed64-4f91-adc5-770d0634b6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:21.724336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:21.725483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:21.726496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:21.726496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:21.726496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:21.726496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 257/521] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:21.726709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7cbf-ed64-4f91-adc5-770d0634b6e0 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-27e29bd9-6a7f-4be3-a252-a87c7fc542e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:21.739248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:21.740360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:21.741560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:21.741560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:21.741560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:21.745080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 265/522] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:21.745996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e29bd9-6a7f-4be3-a252-a87c7fc542e2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:21.821206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:21.828697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:21.855069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7cbf-ed64-4f91-adc5-770d0634b6e0 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:21.856601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e29bd9-6a7f-4be3-a252-a87c7fc542e2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:21.891812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb2f4f-a3ca-4cba-9376-405ab367b6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:21.892449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2f4f-a3ca-4cba-9376-405ab367b6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:21.892731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2f4f-a3ca-4cba-9376-405ab367b6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:21.893018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2f4f-a3ca-4cba-9376-405ab367b6b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:21.893410 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c0787-a7bf-4efd-b89d-a331b13f6d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:21.894085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c0787-a7bf-4efd-b89d-a331b13f6d0e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:21.894372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c0787-a7bf-4efd-b89d-a331b13f6d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:21.894702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c0787-a7bf-4efd-b89d-a331b13f6d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:21.903917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb2f4f-a3ca-4cba-9376-405ab367b6b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:21.905458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb2f4f-a3ca-4cba-9376-405ab367b6b7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-2bcb2f4f-a3ca-4cba-9376-405ab367b6b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:21.920050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:21.921550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:21.922383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:21.922383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:21.922383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:21.922383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 258/523] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:21.923487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb2f4f-a3ca-4cba-9376-405ab367b6b7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:21.978239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c0787-a7bf-4efd-b89d-a331b13f6d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:21.979655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c0787-a7bf-4efd-b89d-a331b13f6d0e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.028084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb2f4f-a3ca-4cba-9376-405ab367b6b7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.052183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:22.059050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:22.066722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35801-9443-4cc5-a282-cb332ae76ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:22.067337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35801-9443-4cc5-a282-cb332ae76ffa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:22.067938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35801-9443-4cc5-a282-cb332ae76ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:22.068220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35801-9443-4cc5-a282-cb332ae76ffa None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:22.068879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35801-9443-4cc5-a282-cb332ae76ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:22.069171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35801-9443-4cc5-a282-cb332ae76ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:22.070580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35801-9443-4cc5-a282-cb332ae76ffa None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.083731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 259/524] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:22.086700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35801-9443-4cc5-a282-cb332ae76ffa None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.092002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 266/525] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:22.093450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c0787-a7bf-4efd-b89d-a331b13f6d0e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.198714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c0787-a7bf-4efd-b89d-a331b13f6d0e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.203656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35801-9443-4cc5-a282-cb332ae76ffa None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.236839 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ee9d-da47-4fcd-add0-61e0ac737d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:22.237520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ee9d-da47-4fcd-add0-61e0ac737d46 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:22.237806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ee9d-da47-4fcd-add0-61e0ac737d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:22.238086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ee9d-da47-4fcd-add0-61e0ac737d46 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:22.238744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ee9d-da47-4fcd-add0-61e0ac737d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:22.239053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ee9d-da47-4fcd-add0-61e0ac737d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:22.240562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ee9d-da47-4fcd-add0-61e0ac737d46 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.243879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fac20-394d-48a9-b128-d386c8ce14c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:22.244495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fac20-394d-48a9-b128-d386c8ce14c4 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:22.244776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fac20-394d-48a9-b128-d386c8ce14c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:22.245051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fac20-394d-48a9-b128-d386c8ce14c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:22.245728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fac20-394d-48a9-b128-d386c8ce14c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:22.246033 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fac20-394d-48a9-b128-d386c8ce14c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:22.247972 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fac20-394d-48a9-b128-d386c8ce14c4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.256035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 267/526] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:22.257786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ee9d-da47-4fcd-add0-61e0ac737d46 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.264547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 260/527] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:22.265533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fac20-394d-48a9-b128-d386c8ce14c4 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.294711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:22.322656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:22.380280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ee9d-da47-4fcd-add0-61e0ac737d46 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.382701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fac20-394d-48a9-b128-d386c8ce14c4 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.418112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc007ba2-12d7-4b0a-8402-44327f8cb532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:22.418752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc007ba2-12d7-4b0a-8402-44327f8cb532 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:22.419043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc007ba2-12d7-4b0a-8402-44327f8cb532 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:22.419316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc007ba2-12d7-4b0a-8402-44327f8cb532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:22.421698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515259-6089-4bcc-9026-8cd65d27063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:22.422529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515259-6089-4bcc-9026-8cd65d27063e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:22.422907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515259-6089-4bcc-9026-8cd65d27063e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:22.423275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515259-6089-4bcc-9026-8cd65d27063e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:22.430208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc007ba2-12d7-4b0a-8402-44327f8cb532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:22.430630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2515259-6089-4bcc-9026-8cd65d27063e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:22.431677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc007ba2-12d7-4b0a-8402-44327f8cb532 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.432307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2515259-6089-4bcc-9026-8cd65d27063e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-cc007ba2-12d7-4b0a-8402-44327f8cb532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:22.446425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:22.447653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:22.448879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:22.448879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:22.448879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-a2515259-6089-4bcc-9026-8cd65d27063e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:22.449600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:22.450632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:22.451757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:22.451757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:22.451757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:22.451757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:22.451757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:22.451757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:22.451757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:22.451757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:22.452993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 261/528] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:22.453606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc007ba2-12d7-4b0a-8402-44327f8cb532 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.454063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 268/529] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:22.454899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515259-6089-4bcc-9026-8cd65d27063e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.562953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:22.574067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515259-6089-4bcc-9026-8cd65d27063e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.575302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc007ba2-12d7-4b0a-8402-44327f8cb532 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.576847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:22.623546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b180-3570-46b7-9d26-03931f846b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:22.624932 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b180-3570-46b7-9d26-03931f846b2c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:22.625475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b180-3570-46b7-9d26-03931f846b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:22.625934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b180-3570-46b7-9d26-03931f846b2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:22.629568 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a427-3a93-4684-a7ae-6c0e438203fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:22.630217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a427-3a93-4684-a7ae-6c0e438203fc None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:22.630504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a427-3a93-4684-a7ae-6c0e438203fc None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:22.630800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a427-3a93-4684-a7ae-6c0e438203fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:22.635318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238b180-3570-46b7-9d26-03931f846b2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:22.636926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238b180-3570-46b7-9d26-03931f846b2c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.638422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a427-3a93-4684-a7ae-6c0e438203fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:22.640465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a427-3a93-4684-a7ae-6c0e438203fc None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-23b4a427-3a93-4684-a7ae-6c0e438203fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:22.653134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:22.654905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:22.657114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:22.657114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:22.657114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:22.657114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:22.657114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:22.657114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:22.657114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:22.657114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:22.659563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 262/530] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:22.660328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a427-3a93-4684-a7ae-6c0e438203fc None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-3238b180-3570-46b7-9d26-03931f846b2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:22.661027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:22.662202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:22.663160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:22.663160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:22.663160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:22.663160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:22.663160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:22.663160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:22.663160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:22.663160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:22.666188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 269/531] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:22.667117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b180-3570-46b7-9d26-03931f846b2c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.783093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b180-3570-46b7-9d26-03931f846b2c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.800859 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a427-3a93-4684-a7ae-6c0e438203fc None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.839427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9e6ad-0f50-4c61-b3df-bab7691060ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:22.840330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e6ad-0f50-4c61-b3df-bab7691060ee None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:22.840726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45275743-811d-4a22-b9d5-0e7e950d73d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:22.841080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e6ad-0f50-4c61-b3df-bab7691060ee None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:22.841543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e6ad-0f50-4c61-b3df-bab7691060ee None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:22.841760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45275743-811d-4a22-b9d5-0e7e950d73d7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:22.842240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45275743-811d-4a22-b9d5-0e7e950d73d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:22.842632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9e6ad-0f50-4c61-b3df-bab7691060ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:22.842741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45275743-811d-4a22-b9d5-0e7e950d73d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:22.843206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9e6ad-0f50-4c61-b3df-bab7691060ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:22.843954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45275743-811d-4a22-b9d5-0e7e950d73d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:22.844491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45275743-811d-4a22-b9d5-0e7e950d73d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:22.845036 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9e6ad-0f50-4c61-b3df-bab7691060ee None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.847173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45275743-811d-4a22-b9d5-0e7e950d73d7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:22.858860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 263/532] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:22.860011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9e6ad-0f50-4c61-b3df-bab7691060ee None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.871991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 270/533] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:22.872680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45275743-811d-4a22-b9d5-0e7e950d73d7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:22.887013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:22.900189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:22.990629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9e6ad-0f50-4c61-b3df-bab7691060ee None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:22.996725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45275743-811d-4a22-b9d5-0e7e950d73d7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:23.029283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf10b52-2cce-4671-9881-ef644125c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:23.029903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf10b52-2cce-4671-9881-ef644125c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.030189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf10b52-2cce-4671-9881-ef644125c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.030502 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf10b52-2cce-4671-9881-ef644125c1d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.031241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf10b52-2cce-4671-9881-ef644125c1d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:23.031507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf10b52-2cce-4671-9881-ef644125c1d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:23.032935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf10b52-2cce-4671-9881-ef644125c1d3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:23.034993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501b293-4892-428e-9841-d8a98a0a8677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:23.035616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501b293-4892-428e-9841-d8a98a0a8677 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.035900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501b293-4892-428e-9841-d8a98a0a8677 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.036177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501b293-4892-428e-9841-d8a98a0a8677 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.037312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501b293-4892-428e-9841-d8a98a0a8677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:23.037628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501b293-4892-428e-9841-d8a98a0a8677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:23.039170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501b293-4892-428e-9841-d8a98a0a8677 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:23.053322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 271/535] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:23.058712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 264/535] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:23.058804 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501b293-4892-428e-9841-d8a98a0a8677 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:23.058875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf10b52-2cce-4671-9881-ef644125c1d3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:23.143750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:23.159307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:23.179465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf10b52-2cce-4671-9881-ef644125c1d3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:23.184288 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501b293-4892-428e-9841-d8a98a0a8677 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:23.223117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6a2ae-b6cc-47c9-8b79-727d0e22f5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:23.223724 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6a2ae-b6cc-47c9-8b79-727d0e22f5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.224009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6a2ae-b6cc-47c9-8b79-727d0e22f5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.224285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6a2ae-b6cc-47c9-8b79-727d0e22f5c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.225021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6a2ae-b6cc-47c9-8b79-727d0e22f5c4 None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=465cff05c2ed4fe19e99289379c2966d) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:23.225368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6a2ae-b6cc-47c9-8b79-727d0e22f5c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:23.225696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4e74-514b-4b7b-ba89-1d278076013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:23.226388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4e74-514b-4b7b-ba89-1d278076013c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.226672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4e74-514b-4b7b-ba89-1d278076013c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.226808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6a2ae-b6cc-47c9-8b79-727d0e22f5c4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:23.227019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4e74-514b-4b7b-ba89-1d278076013c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.235256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4e74-514b-4b7b-ba89-1d278076013c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:23.245735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 265/536] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:23 2022] GET /identity/v3/role_assignments?user.id=465cff05c2ed4fe19e99289379c2966d&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:23.245989 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4e74-514b-4b7b-ba89-1d278076013c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:23.246137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6a2ae-b6cc-47c9-8b79-727d0e22f5c4 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-dc0f4e74-514b-4b7b-ba89-1d278076013c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:23.258968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:23.259877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:23.260693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:23.260693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:23.260693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:23.260693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:23.260693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:23.260693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:23.260693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:23.260693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:23.261077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 272/537] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:23.262130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4e74-514b-4b7b-ba89-1d278076013c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:23.383226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6a2ae-b6cc-47c9-8b79-727d0e22f5c4 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:23.409163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4e74-514b-4b7b-ba89-1d278076013c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:23.433130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c8b44-fde0-4a23-8ced-63a351c197ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:23.433971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8b44-fde0-4a23-8ced-63a351c197ab None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.434257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8b44-fde0-4a23-8ced-63a351c197ab None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.434536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8b44-fde0-4a23-8ced-63a351c197ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.435777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8b44-fde0-4a23-8ced-63a351c197ab None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=2ab45d09f8724d9ca5b6fb1fa050fdf1) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:23.436096 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8b44-fde0-4a23-8ced-63a351c197ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:23.438599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8b44-fde0-4a23-8ced-63a351c197ab None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:23.449449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 266/538] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:23 2022] GET /identity/v3/role_assignments?user.id=2ab45d09f8724d9ca5b6fb1fa050fdf1&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:23.450837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c8b44-fde0-4a23-8ced-63a351c197ab None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:23.470977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:23.471813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:23.487482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86a8e6-709f-448d-b14b-6c2b4959b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:23.488502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a8e6-709f-448d-b14b-6c2b4959b45b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.489094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a8e6-709f-448d-b14b-6c2b4959b45b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.489661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a8e6-709f-448d-b14b-6c2b4959b45b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.490925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a8e6-709f-448d-b14b-6c2b4959b45b None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=d710bb85a200419aa071e119976115c6) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:23.491587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a8e6-709f-448d-b14b-6c2b4959b45b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:23.494261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a8e6-709f-448d-b14b-6c2b4959b45b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:23.505135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 273/539] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:23 2022] GET /identity/v3/role_assignments?user.id=d710bb85a200419aa071e119976115c6&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:23.629975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c8b44-fde0-4a23-8ced-63a351c197ab None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:23.659261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448f11-1296-4776-b68f-3e5307d2d3c1 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.659560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448f11-1296-4776-b68f-3e5307d2d3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.659728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448f11-1296-4776-b68f-3e5307d2d3c1 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.665382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 274/540] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:23.672140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce8b6-9500-48a4-84b0-5a31e54d1208 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.672606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce8b6-9500-48a4-84b0-5a31e54d1208 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.675863 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce8b6-9500-48a4-84b0-5a31e54d1208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.704433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-822ce8b6-9500-48a4-84b0-5a31e54d1208 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:23.704709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-822ce8b6-9500-48a4-84b0-5a31e54d1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:23.715735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda1abd-9d48-4a98-9762-e935b30a02b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:23.716666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda1abd-9d48-4a98-9762-e935b30a02b5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.717102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda1abd-9d48-4a98-9762-e935b30a02b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.717569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda1abd-9d48-4a98-9762-e935b30a02b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.718984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda1abd-9d48-4a98-9762-e935b30a02b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:23.719451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda1abd-9d48-4a98-9762-e935b30a02b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:23.721079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda1abd-9d48-4a98-9762-e935b30a02b5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:23.735977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 267/541] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:23.742691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda1abd-9d48-4a98-9762-e935b30a02b5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:23.832453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 275/542] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:23.871321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:23.908828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda1abd-9d48-4a98-9762-e935b30a02b5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:23.963857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486edc8d-b39b-41ab-84b1-521df4e671dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:23.964547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486edc8d-b39b-41ab-84b1-521df4e671dd None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:23.964835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486edc8d-b39b-41ab-84b1-521df4e671dd None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:23.965123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486edc8d-b39b-41ab-84b1-521df4e671dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:23.965956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486edc8d-b39b-41ab-84b1-521df4e671dd None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=8d0b8fc336694043a34f007b78c45c4a) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:23.966290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486edc8d-b39b-41ab-84b1-521df4e671dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:23.967779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486edc8d-b39b-41ab-84b1-521df4e671dd None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:23.975314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 268/543] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:23 2022] GET /identity/v3/role_assignments?user.id=8d0b8fc336694043a34f007b78c45c4a&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:24.170245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ce8b6-9500-48a4-84b0-5a31e54d1208 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:24.301721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ce8b6-9500-48a4-84b0-5a31e54d1208 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:24.341390 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:24.354853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f994-baad-415c-ba0f-8b4c07366593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:24.355514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f994-baad-415c-ba0f-8b4c07366593 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:24.355798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f994-baad-415c-ba0f-8b4c07366593 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:24.356139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f994-baad-415c-ba0f-8b4c07366593 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:24.368821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146f994-baad-415c-ba0f-8b4c07366593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-8146f994-baad-415c-ba0f-8b4c07366593 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:24.374031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:24.374940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:24.375721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 276/544] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:24.382385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486edc8d-b39b-41ab-84b1-521df4e671dd None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:24.531215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486edc8d-b39b-41ab-84b1-521df4e671dd None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:24.568705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645fb37-c272-403f-98f2-3dd4497ab7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:24.569277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645fb37-c272-403f-98f2-3dd4497ab7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:24.569588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645fb37-c272-403f-98f2-3dd4497ab7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:24.569860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645fb37-c272-403f-98f2-3dd4497ab7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:24.570533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645fb37-c272-403f-98f2-3dd4497ab7c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:24.570833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645fb37-c272-403f-98f2-3dd4497ab7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:24.572204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645fb37-c272-403f-98f2-3dd4497ab7c5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:24.574057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:24.584564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 269/545] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:24.591096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f994-baad-415c-ba0f-8b4c07366593 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:24.764560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f994-baad-415c-ba0f-8b4c07366593 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:24.805140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156e521-7879-420d-8b1b-a9243ec6dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:24.805838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156e521-7879-420d-8b1b-a9243ec6dd06 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:24.806125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156e521-7879-420d-8b1b-a9243ec6dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:24.806402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156e521-7879-420d-8b1b-a9243ec6dd06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:24.819541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156e521-7879-420d-8b1b-a9243ec6dd06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:24.821084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156e521-7879-420d-8b1b-a9243ec6dd06 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-4156e521-7879-420d-8b1b-a9243ec6dd06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:24.838157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:24.839130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:24.840656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:24.840656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:24.840656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:24.840656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 277/546] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:24.850642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645fb37-c272-403f-98f2-3dd4497ab7c5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:25.011461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645fb37-c272-403f-98f2-3dd4497ab7c5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:25.058465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3656e34-13a5-490c-9180-b5f90bf20c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:25.059484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3656e34-13a5-490c-9180-b5f90bf20c4b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:25.060000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3656e34-13a5-490c-9180-b5f90bf20c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:25.060472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3656e34-13a5-490c-9180-b5f90bf20c4b None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:25.061346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3656e34-13a5-490c-9180-b5f90bf20c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:25.062386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3656e34-13a5-490c-9180-b5f90bf20c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:25.063964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3656e34-13a5-490c-9180-b5f90bf20c4b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:25.080735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 270/547] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:25.086777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156e521-7879-420d-8b1b-a9243ec6dd06 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:25.157571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:25.276978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156e521-7879-420d-8b1b-a9243ec6dd06 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:25.346760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51a2d4-81fb-4235-a9f5-7b5d13d5cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:25.347341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51a2d4-81fb-4235-a9f5-7b5d13d5cb46 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:25.347634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51a2d4-81fb-4235-a9f5-7b5d13d5cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:25.347917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51a2d4-81fb-4235-a9f5-7b5d13d5cb46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:25.366031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51a2d4-81fb-4235-a9f5-7b5d13d5cb46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:25.367509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51a2d4-81fb-4235-a9f5-7b5d13d5cb46 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-0f51a2d4-81fb-4235-a9f5-7b5d13d5cb46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:25.382659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:25.384193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:25.385339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 278/548] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:25.390498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3656e34-13a5-490c-9180-b5f90bf20c4b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:25.569316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:25.695905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3656e34-13a5-490c-9180-b5f90bf20c4b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:25.779535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40b3b1-3818-416c-8f67-462d55ee4b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:25.780561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b3b1-3818-416c-8f67-462d55ee4b1d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:25.781042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b3b1-3818-416c-8f67-462d55ee4b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:25.781555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b3b1-3818-416c-8f67-462d55ee4b1d None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:25.782848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40b3b1-3818-416c-8f67-462d55ee4b1d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:25.783367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40b3b1-3818-416c-8f67-462d55ee4b1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:25.785957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40b3b1-3818-416c-8f67-462d55ee4b1d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:25.818381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 271/549] 10.222.0.61 () {56 vars in 1135 bytes} [Thu Sep 22 18:12:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:25.827906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51a2d4-81fb-4235-a9f5-7b5d13d5cb46 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:25.988313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:25.995187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51a2d4-81fb-4235-a9f5-7b5d13d5cb46 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:26.048133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f4f61-8448-4933-9693-e51676951fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:26.048767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f4f61-8448-4933-9693-e51676951fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:26.049056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f4f61-8448-4933-9693-e51676951fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:26.049368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f4f61-8448-4933-9693-e51676951fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:26.149511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f4f61-8448-4933-9693-e51676951fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:26.151084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f4f61-8448-4933-9693-e51676951fc9 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:26.276643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 279/550] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:26.277275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:26.283241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40b3b1-3818-416c-8f67-462d55ee4b1d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:26.349361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a7aa0-7410-4cfa-b3c6-66894fd43c11 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:26.350894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a7aa0-7410-4cfa-b3c6-66894fd43c11 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:26.351382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a7aa0-7410-4cfa-b3c6-66894fd43c11 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:26.353251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 280/551] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:26.358217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb97c74-f9ad-465f-9643-57f12d4c44fc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:26.359255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb97c74-f9ad-465f-9643-57f12d4c44fc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:26.359759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb97c74-f9ad-465f-9643-57f12d4c44fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:26.394414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-8bb97c74-f9ad-465f-9643-57f12d4c44fc None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:26.395635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8bb97c74-f9ad-465f-9643-57f12d4c44fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:26.447953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40b3b1-3818-416c-8f67-462d55ee4b1d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:26.493663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:26.518779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9293d-6655-42c1-bee3-61094fc538e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:26.520133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9293d-6655-42c1-bee3-61094fc538e8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:26.520415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9293d-6655-42c1-bee3-61094fc538e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:26.520688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9293d-6655-42c1-bee3-61094fc538e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:26.528204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 281/552] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:26.538197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9293d-6655-42c1-bee3-61094fc538e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:26.539741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9293d-6655-42c1-bee3-61094fc538e8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-31e9293d-6655-42c1-bee3-61094fc538e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:26.558324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:26.559565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:26.560650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:26.560650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:26.560650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:26.562609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 272/553] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:26.570455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb97c74-f9ad-465f-9643-57f12d4c44fc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:26.661137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad6f39-8b4f-434e-950e-8c6d3f18d9ca None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:26.663871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad6f39-8b4f-434e-950e-8c6d3f18d9ca None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:26.664169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad6f39-8b4f-434e-950e-8c6d3f18d9ca None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:26.666753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 273/554] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:26.677476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d36a8b-8b85-4a03-97f3-8805714eff35 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:26.677927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d36a8b-8b85-4a03-97f3-8805714eff35 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:26.678809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d36a8b-8b85-4a03-97f3-8805714eff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:26.714314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-87d36a8b-8b85-4a03-97f3-8805714eff35 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:26.718826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-87d36a8b-8b85-4a03-97f3-8805714eff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:26.745999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb97c74-f9ad-465f-9643-57f12d4c44fc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:26.782099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:26.794295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234cd43-0cf3-4acc-8bd7-5f2a8acad085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:26.795279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234cd43-0cf3-4acc-8bd7-5f2a8acad085 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:26.795710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234cd43-0cf3-4acc-8bd7-5f2a8acad085 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:26.796273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234cd43-0cf3-4acc-8bd7-5f2a8acad085 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:26.797662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234cd43-0cf3-4acc-8bd7-5f2a8acad085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:26.798808 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234cd43-0cf3-4acc-8bd7-5f2a8acad085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:26.801077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234cd43-0cf3-4acc-8bd7-5f2a8acad085 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:26.823363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 282/555] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:26.829487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf3831-6e1c-4ed6-acca-7eb593e82b58 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:26.829487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf3831-6e1c-4ed6-acca-7eb593e82b58 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:26.829487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf3831-6e1c-4ed6-acca-7eb593e82b58 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:26.832190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 283/556] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:26.835707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf3831-6e1c-4ed6-acca-7eb593e82b58 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:26.838427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 274/557] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:26.841674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a16d0-0fa1-40e2-9832-70e960aad5ee None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:26.842223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a16d0-0fa1-40e2-9832-70e960aad5ee None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:26.842741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a16d0-0fa1-40e2-9832-70e960aad5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:26.872385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-df9a16d0-0fa1-40e2-9832-70e960aad5ee None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:26.873641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-df9a16d0-0fa1-40e2-9832-70e960aad5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:26.950118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 275/558] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:26.950800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a16d0-0fa1-40e2-9832-70e960aad5ee None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:26.978534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:27.002549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf3831-6e1c-4ed6-acca-7eb593e82b58 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.051805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c73f87-28b5-47ec-94ec-18d81c89cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.053034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73f87-28b5-47ec-94ec-18d81c89cf36 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.053710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73f87-28b5-47ec-94ec-18d81c89cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.054485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73f87-28b5-47ec-94ec-18d81c89cf36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.063611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a16d0-0fa1-40e2-9832-70e960aad5ee None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.064262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c73f87-28b5-47ec-94ec-18d81c89cf36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:27.066501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c73f87-28b5-47ec-94ec-18d81c89cf36 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-77c73f87-28b5-47ec-94ec-18d81c89cf36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:27.082110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:27.083866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:27.085749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:27.085749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:27.085749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:27.085749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:27.085749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:27.085749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:27.085749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:27.085749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:27.089201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 284/559] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:27.090682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e20ff0-4d91-4e28-92fe-dbb57e630335 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.090974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e20ff0-4d91-4e28-92fe-dbb57e630335 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.091261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e20ff0-4d91-4e28-92fe-dbb57e630335 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.101595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 285/560] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:27.101595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e20ff0-4d91-4e28-92fe-dbb57e630335 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:27.122275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f59c1-a047-4ecb-a40a-088af6548425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.122921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f59c1-a047-4ecb-a40a-088af6548425 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.123199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f59c1-a047-4ecb-a40a-088af6548425 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.123467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f59c1-a047-4ecb-a40a-088af6548425 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.141380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f59c1-a047-4ecb-a40a-088af6548425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-3b7f59c1-a047-4ecb-a40a-088af6548425 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:27.146231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:27.147234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:27.148082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 276/561] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:27.148806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bd44c-1abb-4103-8d59-aedf83427568 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.148806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bd44c-1abb-4103-8d59-aedf83427568 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.149562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bd44c-1abb-4103-8d59-aedf83427568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.164733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:27.169930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-704bd44c-1abb-4103-8d59-aedf83427568 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:27.171166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-704bd44c-1abb-4103-8d59-aedf83427568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:27.230421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e20ff0-4d91-4e28-92fe-dbb57e630335 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.262560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 277/562] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:27.263477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bd44c-1abb-4103-8d59-aedf83427568 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:27.270330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ae9c-de13-4302-95d7-e40e91438a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.271046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ae9c-de13-4302-95d7-e40e91438a64 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.271419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ae9c-de13-4302-95d7-e40e91438a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.271766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ae9c-de13-4302-95d7-e40e91438a64 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.272478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9ae9c-de13-4302-95d7-e40e91438a64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:27.272789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9ae9c-de13-4302-95d7-e40e91438a64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:27.274278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9ae9c-de13-4302-95d7-e40e91438a64 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:27.288103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 286/563] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:27.288952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ae9c-de13-4302-95d7-e40e91438a64 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:27.305744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:27.407892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bd44c-1abb-4103-8d59-aedf83427568 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.420791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ae9c-de13-4302-95d7-e40e91438a64 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.429262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:27.445326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553d24e-2cc7-4bf9-82a2-c531e2a01c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.446429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d24e-2cc7-4bf9-82a2-c531e2a01c9c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.446714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d24e-2cc7-4bf9-82a2-c531e2a01c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.447015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d24e-2cc7-4bf9-82a2-c531e2a01c9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.459653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553d24e-2cc7-4bf9-82a2-c531e2a01c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:27.461978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1083a32-b689-4a43-a571-4f8d3be7ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.462842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1083a32-b689-4a43-a571-4f8d3be7ab4c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.463366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1083a32-b689-4a43-a571-4f8d3be7ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.463848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1083a32-b689-4a43-a571-4f8d3be7ab4c None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.464717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1083a32-b689-4a43-a571-4f8d3be7ab4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-f553d24e-2cc7-4bf9-82a2-c531e2a01c9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:27.464976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:27.465986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:27.466909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 278/564] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:27.467585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553d24e-2cc7-4bf9-82a2-c531e2a01c9c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:27.468515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1083a32-b689-4a43-a571-4f8d3be7ab4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:27.469943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1083a32-b689-4a43-a571-4f8d3be7ab4c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:27.480983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 287/565] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:27.482018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1083a32-b689-4a43-a571-4f8d3be7ab4c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:27.561550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:27.587456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553d24e-2cc7-4bf9-82a2-c531e2a01c9c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.620199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1083a32-b689-4a43-a571-4f8d3be7ab4c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.621379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019ade5-bbf5-43ae-b8c6-4a90dd209554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.622010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019ade5-bbf5-43ae-b8c6-4a90dd209554 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.622288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019ade5-bbf5-43ae-b8c6-4a90dd209554 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.622557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019ade5-bbf5-43ae-b8c6-4a90dd209554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.633482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019ade5-bbf5-43ae-b8c6-4a90dd209554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-6019ade5-bbf5-43ae-b8c6-4a90dd209554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:27.638757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:27.639777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 279/566] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:27.640615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019ade5-bbf5-43ae-b8c6-4a90dd209554 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:27.655841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83abee6-6362-41e7-8ed2-e91a0f2e1ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.656478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83abee6-6362-41e7-8ed2-e91a0f2e1ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.657612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83abee6-6362-41e7-8ed2-e91a0f2e1ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.658051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83abee6-6362-41e7-8ed2-e91a0f2e1ef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.658799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83abee6-6362-41e7-8ed2-e91a0f2e1ef9 None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=e20585b86c2d45da8ca53fa1db2ccd25) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:27.659110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83abee6-6362-41e7-8ed2-e91a0f2e1ef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:27.660545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83abee6-6362-41e7-8ed2-e91a0f2e1ef9 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:27.666042 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 288/567] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:27 2022] GET /identity/v3/role_assignments?user.id=e20585b86c2d45da8ca53fa1db2ccd25&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:27.666828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83abee6-6362-41e7-8ed2-e91a0f2e1ef9 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:27.703002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:27.767937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019ade5-bbf5-43ae-b8c6-4a90dd209554 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.783687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83abee6-6362-41e7-8ed2-e91a0f2e1ef9 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.808009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3abfd9-191c-4fc0-adc6-45f9df13c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.808705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3abfd9-191c-4fc0-adc6-45f9df13c3af None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.808995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3abfd9-191c-4fc0-adc6-45f9df13c3af None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.809288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3abfd9-191c-4fc0-adc6-45f9df13c3af None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.809975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3abfd9-191c-4fc0-adc6-45f9df13c3af None admin] RBAC: Adding query filter params (name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:27.810276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3abfd9-191c-4fc0-adc6-45f9df13c3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:27.811767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3abfd9-191c-4fc0-adc6-45f9df13c3af None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:27.816134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:27.825133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 280/568] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:27.826215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10335bc1-7526-4394-964c-df901f50ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.826882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10335bc1-7526-4394-964c-df901f50ce12 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.827163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10335bc1-7526-4394-964c-df901f50ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.828012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10335bc1-7526-4394-964c-df901f50ce12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:27.831189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3abfd9-191c-4fc0-adc6-45f9df13c3af None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:27.842292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10335bc1-7526-4394-964c-df901f50ce12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:27.844690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10335bc1-7526-4394-964c-df901f50ce12 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-10335bc1-7526-4394-964c-df901f50ce12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:27.859512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:27.860516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:27.861481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:27.861481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:27.861481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:27.861481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 289/569] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:27.861481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10335bc1-7526-4394-964c-df901f50ce12 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:27.951868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3abfd9-191c-4fc0-adc6-45f9df13c3af None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.960470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:27.981347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10335bc1-7526-4394-964c-df901f50ce12 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:27.996784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8042-08e7-4660-ad11-5234ecb9c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:27.997459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8042-08e7-4660-ad11-5234ecb9c3fc None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:27.997737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8042-08e7-4660-ad11-5234ecb9c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:27.998009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8042-08e7-4660-ad11-5234ecb9c3fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.009264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da8042-08e7-4660-ad11-5234ecb9c3fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-b8da8042-08e7-4660-ad11-5234ecb9c3fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:28.014247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:28.015716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:28.016529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 281/570] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:28.017200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8042-08e7-4660-ad11-5234ecb9c3fc None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.024847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dcb6d-bb87-4748-9462-a958fdda0f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.025512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dcb6d-bb87-4748-9462-a958fdda0f5f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.025797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dcb6d-bb87-4748-9462-a958fdda0f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.026069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dcb6d-bb87-4748-9462-a958fdda0f5f None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.026740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dcb6d-bb87-4748-9462-a958fdda0f5f None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:28.027042 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dcb6d-bb87-4748-9462-a958fdda0f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.028438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dcb6d-bb87-4748-9462-a958fdda0f5f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.038208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 290/571] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:28.039049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dcb6d-bb87-4748-9462-a958fdda0f5f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.095127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:28.144894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8042-08e7-4660-ad11-5234ecb9c3fc None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.153943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dcb6d-bb87-4748-9462-a958fdda0f5f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.184025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23090f87-ba9b-4129-af5d-d6c827682e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.184586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23090f87-ba9b-4129-af5d-d6c827682e30 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.184868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23090f87-ba9b-4129-af5d-d6c827682e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.185141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23090f87-ba9b-4129-af5d-d6c827682e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.191371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b32b5-8ced-44ab-871e-29b744fba53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.192425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b32b5-8ced-44ab-871e-29b744fba53d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.192726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b32b5-8ced-44ab-871e-29b744fba53d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.192990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b32b5-8ced-44ab-871e-29b744fba53d None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.194068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b32b5-8ced-44ab-871e-29b744fba53d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:28.194382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b32b5-8ced-44ab-871e-29b744fba53d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.195683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23090f87-ba9b-4129-af5d-d6c827682e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.195884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b32b5-8ced-44ab-871e-29b744fba53d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.197102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23090f87-ba9b-4129-af5d-d6c827682e30 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.209109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 291/572] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-23090f87-ba9b-4129-af5d-d6c827682e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:28.212301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:28.213223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:28.219720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:28.219720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:28.219720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:28.219720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 282/573] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:28.219720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23090f87-ba9b-4129-af5d-d6c827682e30 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.219993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b32b5-8ced-44ab-871e-29b744fba53d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.225913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:28.323714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b32b5-8ced-44ab-871e-29b744fba53d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.329935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23090f87-ba9b-4129-af5d-d6c827682e30 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.341968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:28.359863 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35376c-ff63-454f-a93f-933cba6464f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.360407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35376c-ff63-454f-a93f-933cba6464f6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.360696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35376c-ff63-454f-a93f-933cba6464f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.360975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35376c-ff63-454f-a93f-933cba6464f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.361685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35376c-ff63-454f-a93f-933cba6464f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:28.361999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35376c-ff63-454f-a93f-933cba6464f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.363370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35376c-ff63-454f-a93f-933cba6464f6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.369170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c917004-ff08-45aa-9e2e-5984ddc9ea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.370030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c917004-ff08-45aa-9e2e-5984ddc9ea29 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.370468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c917004-ff08-45aa-9e2e-5984ddc9ea29 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.370885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c917004-ff08-45aa-9e2e-5984ddc9ea29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.371896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 292/574] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:28.372593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35376c-ff63-454f-a93f-933cba6464f6 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.387134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c917004-ff08-45aa-9e2e-5984ddc9ea29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c917004-ff08-45aa-9e2e-5984ddc9ea29 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-2c917004-ff08-45aa-9e2e-5984ddc9ea29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:28.404500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:28.406108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:28.406985 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:28.406985 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:28.406985 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:28.408460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 283/575] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:28.409440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c917004-ff08-45aa-9e2e-5984ddc9ea29 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.453517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:28.493711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35376c-ff63-454f-a93f-933cba6464f6 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.518419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c917004-ff08-45aa-9e2e-5984ddc9ea29 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.532458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5375e-5c79-4fbb-ae1d-0a2542d4e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.533281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5375e-5c79-4fbb-ae1d-0a2542d4e5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.533461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5375e-5c79-4fbb-ae1d-0a2542d4e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.533686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5375e-5c79-4fbb-ae1d-0a2542d4e5c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.541344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5375e-5c79-4fbb-ae1d-0a2542d4e5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.542808 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5375e-5c79-4fbb-ae1d-0a2542d4e5c8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-e0a5375e-5c79-4fbb-ae1d-0a2542d4e5c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:28.556030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:28.557218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 18:12:28.558502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:28.559060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4886e19-4b9e-4372-aa52-d4419bb071ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.559060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4886e19-4b9e-4372-aa52-d4419bb071ff None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.559060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4886e19-4b9e-4372-aa52-d4419bb071ff None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.559060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4886e19-4b9e-4372-aa52-d4419bb071ff None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.559354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4886e19-4b9e-4372-aa52-d4419bb071ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:28.559354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4886e19-4b9e-4372-aa52-d4419bb071ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.560004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4886e19-4b9e-4372-aa52-d4419bb071ff None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.562314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 293/576] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:28.564336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5375e-5c79-4fbb-ae1d-0a2542d4e5c8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.573932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 284/577] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:28.574778 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4886e19-4b9e-4372-aa52-d4419bb071ff None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.605715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:28.714218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5375e-5c79-4fbb-ae1d-0a2542d4e5c8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.715839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4886e19-4b9e-4372-aa52-d4419bb071ff None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.741531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:28.751562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d5d4-b9d0-43e1-8498-b0179b6ec124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.752273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d5d4-b9d0-43e1-8498-b0179b6ec124 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.752556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d5d4-b9d0-43e1-8498-b0179b6ec124 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.752871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d5d4-b9d0-43e1-8498-b0179b6ec124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.755491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc019a-50f1-4b79-80df-3c2e23b3bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.756210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc019a-50f1-4b79-80df-3c2e23b3bae7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.756593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc019a-50f1-4b79-80df-3c2e23b3bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.756970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc019a-50f1-4b79-80df-3c2e23b3bae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.757747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc019a-50f1-4b79-80df-3c2e23b3bae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:28.758168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc019a-50f1-4b79-80df-3c2e23b3bae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.759634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc019a-50f1-4b79-80df-3c2e23b3bae7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.764810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771d5d4-b9d0-43e1-8498-b0179b6ec124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.766401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771d5d4-b9d0-43e1-8498-b0179b6ec124 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.776884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 285/578] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:28.776884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc019a-50f1-4b79-80df-3c2e23b3bae7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-9771d5d4-b9d0-43e1-8498-b0179b6ec124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:28.786517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:28.787664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:28.788776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:28.788776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:28.788776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:28.793332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 294/579] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:28.794122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d5d4-b9d0-43e1-8498-b0179b6ec124 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.864725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:28.884890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc019a-50f1-4b79-80df-3c2e23b3bae7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.903465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d5d4-b9d0-43e1-8498-b0179b6ec124 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:28.919436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67d568-165f-4208-911d-7af67192aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.920227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67d568-165f-4208-911d-7af67192aa10 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.920625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67d568-165f-4208-911d-7af67192aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.921031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67d568-165f-4208-911d-7af67192aa10 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.922398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67d568-165f-4208-911d-7af67192aa10 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:28.922805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67d568-165f-4208-911d-7af67192aa10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.924333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67d568-165f-4208-911d-7af67192aa10 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.942743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b108-4264-4d48-84f9-bb9bc876f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:28.943011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 286/580] 10.222.0.61 () {56 vars in 1137 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:28.943542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b108-4264-4d48-84f9-bb9bc876f06a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:28.943943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b108-4264-4d48-84f9-bb9bc876f06a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:28.944318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b108-4264-4d48-84f9-bb9bc876f06a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:28.944471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67d568-165f-4208-911d-7af67192aa10 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:28.955263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501b108-4264-4d48-84f9-bb9bc876f06a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:28.956849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501b108-4264-4d48-84f9-bb9bc876f06a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-8501b108-4264-4d48-84f9-bb9bc876f06a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:28.971322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:28.972466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:28.973750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:28.975894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 295/581] 10.222.0.61 () {56 vars in 1093 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:28.976870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b108-4264-4d48-84f9-bb9bc876f06a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.021981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:29.057579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67d568-165f-4208-911d-7af67192aa10 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.087875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b108-4264-4d48-84f9-bb9bc876f06a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.092152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc235f-5bc2-445c-ba86-bd9992646662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.092792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc235f-5bc2-445c-ba86-bd9992646662 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.093610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc235f-5bc2-445c-ba86-bd9992646662 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.093884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc235f-5bc2-445c-ba86-bd9992646662 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.101226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc235f-5bc2-445c-ba86-bd9992646662 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.102701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc235f-5bc2-445c-ba86-bd9992646662 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.106885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-51cc235f-5bc2-445c-ba86-bd9992646662 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:29.118291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:29.119467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 18:12:29.120584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:29.128538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 287/582] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:29.129357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc235f-5bc2-445c-ba86-bd9992646662 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.133853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1dd3f-9c5a-4656-ac7f-9105543bd115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.134472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1dd3f-9c5a-4656-ac7f-9105543bd115 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.134752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1dd3f-9c5a-4656-ac7f-9105543bd115 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.135088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1dd3f-9c5a-4656-ac7f-9105543bd115 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.135730 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1dd3f-9c5a-4656-ac7f-9105543bd115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:29.136058 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1dd3f-9c5a-4656-ac7f-9105543bd115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.137445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1dd3f-9c5a-4656-ac7f-9105543bd115 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.150860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 296/583] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:29.151427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1dd3f-9c5a-4656-ac7f-9105543bd115 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.238251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc235f-5bc2-445c-ba86-bd9992646662 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.255732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:29.259779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1dd3f-9c5a-4656-ac7f-9105543bd115 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.275207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dc4f3-5188-4720-82ac-72890740b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.275860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dc4f3-5188-4720-82ac-72890740b1ee None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.276129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dc4f3-5188-4720-82ac-72890740b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.276400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dc4f3-5188-4720-82ac-72890740b1ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.288072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dc4f3-5188-4720-82ac-72890740b1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.289543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dc4f3-5188-4720-82ac-72890740b1ee None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.296309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0685a0-5198-4bc9-8fa1-62db87f41758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.296920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0685a0-5198-4bc9-8fa1-62db87f41758 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.297198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0685a0-5198-4bc9-8fa1-62db87f41758 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.297499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0685a0-5198-4bc9-8fa1-62db87f41758 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.298219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0685a0-5198-4bc9-8fa1-62db87f41758 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:29.298522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0685a0-5198-4bc9-8fa1-62db87f41758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.299928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0685a0-5198-4bc9-8fa1-62db87f41758 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-a88dc4f3-5188-4720-82ac-72890740b1ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:29.303912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:29.304811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:29.305738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:29.305738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:29.305738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:29.309556 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 288/584] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:29.310414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dc4f3-5188-4720-82ac-72890740b1ee None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.335344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 297/585] 10.222.0.61 () {56 vars in 1133 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:29.335344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0685a0-5198-4bc9-8fa1-62db87f41758 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.368122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:29.424458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dc4f3-5188-4720-82ac-72890740b1ee None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.455726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0685a0-5198-4bc9-8fa1-62db87f41758 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.464729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c74386-8a62-487c-9f1f-1687803788b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.465372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c74386-8a62-487c-9f1f-1687803788b7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.465712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c74386-8a62-487c-9f1f-1687803788b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.466036 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c74386-8a62-487c-9f1f-1687803788b7 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.466780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c74386-8a62-487c-9f1f-1687803788b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:29.467505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c74386-8a62-487c-9f1f-1687803788b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.469185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c74386-8a62-487c-9f1f-1687803788b7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.497307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 289/586] 10.222.0.61 () {56 vars in 1137 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:29.497752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4066be-0219-491c-8a25-ea3ffe0dfffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.498268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c74386-8a62-487c-9f1f-1687803788b7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.498540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4066be-0219-491c-8a25-ea3ffe0dfffe None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.498884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4066be-0219-491c-8a25-ea3ffe0dfffe None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.499736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4066be-0219-491c-8a25-ea3ffe0dfffe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.508762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4066be-0219-491c-8a25-ea3ffe0dfffe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.510626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4066be-0219-491c-8a25-ea3ffe0dfffe None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-da4066be-0219-491c-8a25-ea3ffe0dfffe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:29.527367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:29.529190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 298/587] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:29.530964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4066be-0219-491c-8a25-ea3ffe0dfffe None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.554838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:29.619479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c74386-8a62-487c-9f1f-1687803788b7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.632393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:29.665865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725f04a-54ab-47e5-9918-01225e996475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.667120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725f04a-54ab-47e5-9918-01225e996475 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.668131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725f04a-54ab-47e5-9918-01225e996475 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.668704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725f04a-54ab-47e5-9918-01225e996475 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.669392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725f04a-54ab-47e5-9918-01225e996475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:29.669494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4066be-0219-491c-8a25-ea3ffe0dfffe None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.669697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725f04a-54ab-47e5-9918-01225e996475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.671116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725f04a-54ab-47e5-9918-01225e996475 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.684296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 290/588] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:29.685437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725f04a-54ab-47e5-9918-01225e996475 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.722074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c2863-2932-4f47-bc7c-c8c06f044260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.722894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c2863-2932-4f47-bc7c-c8c06f044260 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.723275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c2863-2932-4f47-bc7c-c8c06f044260 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.723672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c2863-2932-4f47-bc7c-c8c06f044260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.737494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c2863-2932-4f47-bc7c-c8c06f044260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.741847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c2863-2932-4f47-bc7c-c8c06f044260 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-910c2863-2932-4f47-bc7c-c8c06f044260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:29.768611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:29.770205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:29.771230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:29.771230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:29.771230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:29.774679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 299/589] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:29.775673 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c2863-2932-4f47-bc7c-c8c06f044260 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.822155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725f04a-54ab-47e5-9918-01225e996475 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.859076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052baf-deef-4216-932b-e54861a6dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.859718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052baf-deef-4216-932b-e54861a6dc44 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.859995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052baf-deef-4216-932b-e54861a6dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.860264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052baf-deef-4216-932b-e54861a6dc44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.863530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:29.872391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052baf-deef-4216-932b-e54861a6dc44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.873960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052baf-deef-4216-932b-e54861a6dc44 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ff052baf-deef-4216-932b-e54861a6dc44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:29.891070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:29.892982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:29.894822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:29.894822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:29.894822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:29.894822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 291/590] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:29.894822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052baf-deef-4216-932b-e54861a6dc44 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:29.904451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c2863-2932-4f47-bc7c-c8c06f044260 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:29.921934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:29.940817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e765b-6f49-43ad-8d91-c4f44ca92734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:29.941420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e765b-6f49-43ad-8d91-c4f44ca92734 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:29.941689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e765b-6f49-43ad-8d91-c4f44ca92734 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:29.942144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e765b-6f49-43ad-8d91-c4f44ca92734 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:29.942710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e765b-6f49-43ad-8d91-c4f44ca92734 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:29.943019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e765b-6f49-43ad-8d91-c4f44ca92734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:29.944459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e765b-6f49-43ad-8d91-c4f44ca92734 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:29.962916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 300/591] 10.222.0.61 () {56 vars in 1139 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:29.963762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e765b-6f49-43ad-8d91-c4f44ca92734 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.044222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052baf-deef-4216-932b-e54861a6dc44 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.067834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e765b-6f49-43ad-8d91-c4f44ca92734 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.103422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1d0b8-f45d-4d49-bc0a-8291b134e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.104443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1d0b8-f45d-4d49-bc0a-8291b134e930 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.104762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1d0b8-f45d-4d49-bc0a-8291b134e930 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.104884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:30.105114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1d0b8-f45d-4d49-bc0a-8291b134e930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.114982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1d0b8-f45d-4d49-bc0a-8291b134e930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.116086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8dab11-3db1-4e25-8c12-6551682c069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.116709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dab11-3db1-4e25-8c12-6551682c069d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.116988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dab11-3db1-4e25-8c12-6551682c069d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.117288 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dab11-3db1-4e25-8c12-6551682c069d None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.117626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1d0b8-f45d-4d49-bc0a-8291b134e930 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:30.117940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8dab11-3db1-4e25-8c12-6551682c069d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:30.118291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8dab11-3db1-4e25-8c12-6551682c069d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.119702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8dab11-3db1-4e25-8c12-6551682c069d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:30.138690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 301/592] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:30.138690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18baf7c8-c08c-4724-bd94-29ed7235a636 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.138690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18baf7c8-c08c-4724-bd94-29ed7235a636 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.138690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18baf7c8-c08c-4724-bd94-29ed7235a636 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-d2a1d0b8-f45d-4d49-bc0a-8291b134e930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:30.139089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:30.139867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:30.140755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:30.140755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:30.140755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:30.140755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:30.140755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:30.140755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:30.140755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:30.140755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:30.141179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 302/593] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:30.141179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18baf7c8-c08c-4724-bd94-29ed7235a636 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.141407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 292/594] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:30.141407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1d0b8-f45d-4d49-bc0a-8291b134e930 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.239119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:30.262526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1d0b8-f45d-4d49-bc0a-8291b134e930 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.269418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18baf7c8-c08c-4724-bd94-29ed7235a636 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.301261 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1f100-1a29-4f52-9c61-0feec15ad089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.301930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1f100-1a29-4f52-9c61-0feec15ad089 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.302211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1f100-1a29-4f52-9c61-0feec15ad089 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.302484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1f100-1a29-4f52-9c61-0feec15ad089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.308140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a5ec2-df90-4557-a4ad-17954f3bc3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.308760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a5ec2-df90-4557-a4ad-17954f3bc3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.309043 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a5ec2-df90-4557-a4ad-17954f3bc3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.309347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a5ec2-df90-4557-a4ad-17954f3bc3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.309994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a5ec2-df90-4557-a4ad-17954f3bc3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:30.310305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a5ec2-df90-4557-a4ad-17954f3bc3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.311711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a5ec2-df90-4557-a4ad-17954f3bc3a2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:30.314016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1f100-1a29-4f52-9c61-0feec15ad089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.315466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1f100-1a29-4f52-9c61-0feec15ad089 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:30.324567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 303/595] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:30.325426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a5ec2-df90-4557-a4ad-17954f3bc3a2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-63f1f100-1a29-4f52-9c61-0feec15ad089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:30.330774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:30.332486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:30.334214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:30.334214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:30.334214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:30.336717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 293/596] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:30.337954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75f421-fae8-47ed-8553-6aeb8a2effab None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.338240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75f421-fae8-47ed-8553-6aeb8a2effab None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.338663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75f421-fae8-47ed-8553-6aeb8a2effab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.358169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4b75f421-fae8-47ed-8553-6aeb8a2effab None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:30.360024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4b75f421-fae8-47ed-8553-6aeb8a2effab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:30.381765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:30.437696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a5ec2-df90-4557-a4ad-17954f3bc3a2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.442700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 294/597] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:30.443595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75f421-fae8-47ed-8553-6aeb8a2effab None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.488255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe99d-37a3-4013-a8a2-a1260b6b11b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.488902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe99d-37a3-4013-a8a2-a1260b6b11b3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.489187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe99d-37a3-4013-a8a2-a1260b6b11b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.489496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe99d-37a3-4013-a8a2-a1260b6b11b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.497263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe99d-37a3-4013-a8a2-a1260b6b11b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.498926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abe99d-37a3-4013-a8a2-a1260b6b11b3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-c1abe99d-37a3-4013-a8a2-a1260b6b11b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:30.521889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:30.523252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 304/598] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:30.524583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe99d-37a3-4013-a8a2-a1260b6b11b3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.542894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:30.585782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75f421-fae8-47ed-8553-6aeb8a2effab None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.624946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1ed5a-d681-4b81-a2cd-e58e91fe4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.625679 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1ed5a-d681-4b81-a2cd-e58e91fe4741 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.625838 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1ed5a-d681-4b81-a2cd-e58e91fe4741 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.626088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1ed5a-d681-4b81-a2cd-e58e91fe4741 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.627281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1ed5a-d681-4b81-a2cd-e58e91fe4741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:30.627592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1ed5a-d681-4b81-a2cd-e58e91fe4741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.628999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1ed5a-d681-4b81-a2cd-e58e91fe4741 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:30.647653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 295/599] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:30.647653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1ed5a-d681-4b81-a2cd-e58e91fe4741 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.657457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe99d-37a3-4013-a8a2-a1260b6b11b3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.671682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:30.701595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73015830-e9ba-49e5-a075-f3025809f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.702891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73015830-e9ba-49e5-a075-f3025809f978 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.703250 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73015830-e9ba-49e5-a075-f3025809f978 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.703595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73015830-e9ba-49e5-a075-f3025809f978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.710969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73015830-e9ba-49e5-a075-f3025809f978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.712916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73015830-e9ba-49e5-a075-f3025809f978 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-73015830-e9ba-49e5-a075-f3025809f978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:30.725929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:30.727087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:30.727955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:30.727955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:30.727955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:30.727955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:30.727955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:30.727955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:30.727955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:30.727955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:30.727955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 305/600] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:30.728422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73015830-e9ba-49e5-a075-f3025809f978 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.771991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1ed5a-d681-4b81-a2cd-e58e91fe4741 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.796678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:30.808176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027c24-fa59-475c-af32-2178e2f11892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.808857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027c24-fa59-475c-af32-2178e2f11892 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.809142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027c24-fa59-475c-af32-2178e2f11892 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.809435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027c24-fa59-475c-af32-2178e2f11892 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.810096 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d027c24-fa59-475c-af32-2178e2f11892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:30.810469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d027c24-fa59-475c-af32-2178e2f11892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.811829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d027c24-fa59-475c-af32-2178e2f11892 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:30.824224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 296/601] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:30.824825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027c24-fa59-475c-af32-2178e2f11892 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.847597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73015830-e9ba-49e5-a075-f3025809f978 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.882430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4872e3-c3c9-41e6-926f-737535841643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.883070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4872e3-c3c9-41e6-926f-737535841643 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.883356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4872e3-c3c9-41e6-926f-737535841643 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.883663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4872e3-c3c9-41e6-926f-737535841643 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.884430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4872e3-c3c9-41e6-926f-737535841643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:30.884748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4872e3-c3c9-41e6-926f-737535841643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.886362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4872e3-c3c9-41e6-926f-737535841643 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:30.900189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 306/602] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:30.901410 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4872e3-c3c9-41e6-926f-737535841643 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:30.936477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:30.938033 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027c24-fa59-475c-af32-2178e2f11892 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:30.980117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f6bc2-fb45-456e-aa7e-bb0727ac08ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:30.980777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f6bc2-fb45-456e-aa7e-bb0727ac08ac None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:30.981067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f6bc2-fb45-456e-aa7e-bb0727ac08ac None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:30.981355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f6bc2-fb45-456e-aa7e-bb0727ac08ac None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/465cff05c2ed4fe19e99289379c2966d/roles/e564a081239e4e48a6b6257c8cec5e4d` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:30.996726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f6bc2-fb45-456e-aa7e-bb0727ac08ac None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=465cff05c2ed4fe19e99289379c2966d, role_id=e564a081239e4e48a6b6257c8cec5e4d)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:30.998193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f6bc2-fb45-456e-aa7e-bb0727ac08ac None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:31.010841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 297/603] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:12:30 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/465cff05c2ed4fe19e99289379c2966d/roles/e564a081239e4e48a6b6257c8cec5e4d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:12:31.011657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f6bc2-fb45-456e-aa7e-bb0727ac08ac None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:31.043784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4872e3-c3c9-41e6-926f-737535841643 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:31.055272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:31.086756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae00234-3b90-4b9b-bbba-8c67bf46db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:31.087542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00234-3b90-4b9b-bbba-8c67bf46db0d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:31.087889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00234-3b90-4b9b-bbba-8c67bf46db0d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:31.088318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00234-3b90-4b9b-bbba-8c67bf46db0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:31.108506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae00234-3b90-4b9b-bbba-8c67bf46db0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-2ae00234-3b90-4b9b-bbba-8c67bf46db0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:31.115177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:31.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 307/604] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:31.117807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae00234-3b90-4b9b-bbba-8c67bf46db0d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:31.165312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f6bc2-fb45-456e-aa7e-bb0727ac08ac None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:31.212293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59654929-7089-47fe-a13d-f73f90cbf72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:31.213417 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59654929-7089-47fe-a13d-f73f90cbf72a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:31.213940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59654929-7089-47fe-a13d-f73f90cbf72a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:31.214446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59654929-7089-47fe-a13d-f73f90cbf72a None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:31.215867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59654929-7089-47fe-a13d-f73f90cbf72a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:31.216439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59654929-7089-47fe-a13d-f73f90cbf72a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:31.220003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59654929-7089-47fe-a13d-f73f90cbf72a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:31.239601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:31.246253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 298/605] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:31.247894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59654929-7089-47fe-a13d-f73f90cbf72a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:31.260217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae00234-3b90-4b9b-bbba-8c67bf46db0d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:31.305404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be90fd-c94a-4cc6-b60c-d284601a0dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:31.306216 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be90fd-c94a-4cc6-b60c-d284601a0dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:31.306605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be90fd-c94a-4cc6-b60c-d284601a0dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:31.306982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be90fd-c94a-4cc6-b60c-d284601a0dd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:31.316078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be90fd-c94a-4cc6-b60c-d284601a0dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:31.317860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be90fd-c94a-4cc6-b60c-d284601a0dd0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-00be90fd-c94a-4cc6-b60c-d284601a0dd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:31.332588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:31.334351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 308/606] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:31.335781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be90fd-c94a-4cc6-b60c-d284601a0dd0 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:31.369042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:31.376412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59654929-7089-47fe-a13d-f73f90cbf72a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:31.424961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071d919-4b7d-47c4-9e32-f724f57a8f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:31.425763 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d919-4b7d-47c4-9e32-f724f57a8f5e None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:31.426113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d919-4b7d-47c4-9e32-f724f57a8f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:31.426460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d919-4b7d-47c4-9e32-f724f57a8f5e None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/d710bb85a200419aa071e119976115c6/roles/e564a081239e4e48a6b6257c8cec5e4d` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:31.443960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071d919-4b7d-47c4-9e32-f724f57a8f5e None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=d710bb85a200419aa071e119976115c6, role_id=e564a081239e4e48a6b6257c8cec5e4d)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:31.445582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071d919-4b7d-47c4-9e32-f724f57a8f5e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:31.457842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be90fd-c94a-4cc6-b60c-d284601a0dd0 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:31.473270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 299/607] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:12:31 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/d710bb85a200419aa071e119976115c6/roles/e564a081239e4e48a6b6257c8cec5e4d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:12:31.473270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071d919-4b7d-47c4-9e32-f724f57a8f5e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:31.534066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe20f5-07ff-477f-854a-5128d9d1f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:31.535261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe20f5-07ff-477f-854a-5128d9d1f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:31.535799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe20f5-07ff-477f-854a-5128d9d1f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:31.536399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe20f5-07ff-477f-854a-5128d9d1f9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:31.537719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe20f5-07ff-477f-854a-5128d9d1f9a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:31.538315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe20f5-07ff-477f-854a-5128d9d1f9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:31.541625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe20f5-07ff-477f-854a-5128d9d1f9a8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:31.559971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 309/608] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:31.561502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe20f5-07ff-477f-854a-5128d9d1f9a8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:31.585066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:31.690284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071d919-4b7d-47c4-9e32-f724f57a8f5e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:31.723133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe20f5-07ff-477f-854a-5128d9d1f9a8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:31.735890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731cf7-a38e-4b58-8a1b-d0fc5c33d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:31.736858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731cf7-a38e-4b58-8a1b-d0fc5c33d59c None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:31.737379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731cf7-a38e-4b58-8a1b-d0fc5c33d59c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:31.737888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731cf7-a38e-4b58-8a1b-d0fc5c33d59c None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/2ab45d09f8724d9ca5b6fb1fa050fdf1/roles/e564a081239e4e48a6b6257c8cec5e4d` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:31.756775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e731cf7-a38e-4b58-8a1b-d0fc5c33d59c None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=2ab45d09f8724d9ca5b6fb1fa050fdf1, role_id=e564a081239e4e48a6b6257c8cec5e4d)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:31.758976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e731cf7-a38e-4b58-8a1b-d0fc5c33d59c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:31.761572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:31.778713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 300/609] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:12:31 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/2ab45d09f8724d9ca5b6fb1fa050fdf1/roles/e564a081239e4e48a6b6257c8cec5e4d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:12:31.779997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731cf7-a38e-4b58-8a1b-d0fc5c33d59c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:31.794464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b960e-110b-428d-a5dd-7a886b18eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:31.797818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b960e-110b-428d-a5dd-7a886b18eb74 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:31.797818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b960e-110b-428d-a5dd-7a886b18eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:31.797818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b960e-110b-428d-a5dd-7a886b18eb74 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:31.798916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b960e-110b-428d-a5dd-7a886b18eb74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:31.799645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b960e-110b-428d-a5dd-7a886b18eb74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:31.804231 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b960e-110b-428d-a5dd-7a886b18eb74 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:31.827856 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 310/610] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:31.838697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b960e-110b-428d-a5dd-7a886b18eb74 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:31.995888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:32.034618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731cf7-a38e-4b58-8a1b-d0fc5c33d59c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:32.070841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b960e-110b-428d-a5dd-7a886b18eb74 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:32.087497 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bebc5-f04e-430e-98bc-185ee87bf9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:32.088414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bebc5-f04e-430e-98bc-185ee87bf9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:32.088772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bebc5-f04e-430e-98bc-185ee87bf9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:32.089482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bebc5-f04e-430e-98bc-185ee87bf9f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:32.103025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bebc5-f04e-430e-98bc-185ee87bf9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:32.104916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bebc5-f04e-430e-98bc-185ee87bf9f9 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:32.110869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb7453-23ad-4e24-98a8-e4537c548038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:32.111540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb7453-23ad-4e24-98a8-e4537c548038 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:32.111816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb7453-23ad-4e24-98a8-e4537c548038 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:32.112089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb7453-23ad-4e24-98a8-e4537c548038 None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/8d0b8fc336694043a34f007b78c45c4a/roles/e564a081239e4e48a6b6257c8cec5e4d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-4a2bebc5-f04e-430e-98bc-185ee87bf9f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:32.123431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:32.124995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:32.125918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:32.125918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:32.125918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:32.129265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 301/611] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:32.132538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bebc5-f04e-430e-98bc-185ee87bf9f9 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:32.133074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb7453-23ad-4e24-98a8-e4537c548038 None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=8d0b8fc336694043a34f007b78c45c4a, role_id=e564a081239e4e48a6b6257c8cec5e4d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:32.134582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb7453-23ad-4e24-98a8-e4537c548038 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:32.160220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 311/612] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:12:31 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/8d0b8fc336694043a34f007b78c45c4a/roles/e564a081239e4e48a6b6257c8cec5e4d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:12:32.207450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:32.284464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bebc5-f04e-430e-98bc-185ee87bf9f9 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:32.327208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d4046-b293-49cf-81c3-daeb45cfc27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:32.327883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d4046-b293-49cf-81c3-daeb45cfc27e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:32.328167 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d4046-b293-49cf-81c3-daeb45cfc27e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:32.328445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d4046-b293-49cf-81c3-daeb45cfc27e None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:32.329109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d4046-b293-49cf-81c3-daeb45cfc27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:32.329449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d4046-b293-49cf-81c3-daeb45cfc27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:32.330878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d4046-b293-49cf-81c3-daeb45cfc27e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:32.345344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 302/613] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:32.350744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb7453-23ad-4e24-98a8-e4537c548038 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:32.507117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb7453-23ad-4e24-98a8-e4537c548038 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:32.531909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:32.551395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27607e3a-1c71-4d5e-81c8-34c26a4b583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:32.551960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27607e3a-1c71-4d5e-81c8-34c26a4b583b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:32.552245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27607e3a-1c71-4d5e-81c8-34c26a4b583b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:32.552514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27607e3a-1c71-4d5e-81c8-34c26a4b583b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:32.560476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27607e3a-1c71-4d5e-81c8-34c26a4b583b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:32.561981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27607e3a-1c71-4d5e-81c8-34c26a4b583b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-27607e3a-1c71-4d5e-81c8-34c26a4b583b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:32.574577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:32.575533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:32.576438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 312/614] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:32.582882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d4046-b293-49cf-81c3-daeb45cfc27e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:32.714737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d4046-b293-49cf-81c3-daeb45cfc27e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:32.726138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:32.760706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6f974-5c15-44b1-8a3a-234391a5876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:32.761347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6f974-5c15-44b1-8a3a-234391a5876f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:32.761629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6f974-5c15-44b1-8a3a-234391a5876f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:32.761901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6f974-5c15-44b1-8a3a-234391a5876f None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:32.762632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6f974-5c15-44b1-8a3a-234391a5876f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:32.762934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6f974-5c15-44b1-8a3a-234391a5876f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:32.764359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6f974-5c15-44b1-8a3a-234391a5876f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:32.783643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 303/615] 10.222.0.61 () {56 vars in 1135 bytes} [Thu Sep 22 18:12:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:32.789204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27607e3a-1c71-4d5e-81c8-34c26a4b583b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:32.960361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27607e3a-1c71-4d5e-81c8-34c26a4b583b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:33.020476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997871fb-105e-46db-8581-3b282b4ca56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:33.021676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997871fb-105e-46db-8581-3b282b4ca56c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:33.022072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997871fb-105e-46db-8581-3b282b4ca56c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:33.022540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997871fb-105e-46db-8581-3b282b4ca56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:33.048354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997871fb-105e-46db-8581-3b282b4ca56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:33.051091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997871fb-105e-46db-8581-3b282b4ca56c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-997871fb-105e-46db-8581-3b282b4ca56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:33.079211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:33.080208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:33.081077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:33.081077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:33.081077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:33.082674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 313/616] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:33.087790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6f974-5c15-44b1-8a3a-234391a5876f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:33.250362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6f974-5c15-44b1-8a3a-234391a5876f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:33.311575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4446da0-f9c3-4db5-9427-f6858822746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:33.312726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4446da0-f9c3-4db5-9427-f6858822746c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:33.313006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4446da0-f9c3-4db5-9427-f6858822746c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:33.313302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4446da0-f9c3-4db5-9427-f6858822746c None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:33.313963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4446da0-f9c3-4db5-9427-f6858822746c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:33.314264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4446da0-f9c3-4db5-9427-f6858822746c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:33.315630 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4446da0-f9c3-4db5-9427-f6858822746c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:33.333222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 304/617] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:33.339294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997871fb-105e-46db-8581-3b282b4ca56c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:33.399726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:33.516683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997871fb-105e-46db-8581-3b282b4ca56c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:33.564351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4cda2-a75e-4672-b260-be8d011430f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:33.564997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4cda2-a75e-4672-b260-be8d011430f3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:33.565293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4cda2-a75e-4672-b260-be8d011430f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:33.565571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4cda2-a75e-4672-b260-be8d011430f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:33.573878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4cda2-a75e-4672-b260-be8d011430f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:33.575362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4cda2-a75e-4672-b260-be8d011430f3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-69e4cda2-a75e-4672-b260-be8d011430f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:33.589040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:33.590174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:33.591051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:33.591051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:33.591051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:33.591051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:33.591051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:33.591051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:33.591051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:33.591051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:33.591051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 314/618] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:33.598149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4446da0-f9c3-4db5-9427-f6858822746c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:33.619088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369e05-7446-40c7-a767-619bafcd553f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:33.619434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369e05-7446-40c7-a767-619bafcd553f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:33.619652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369e05-7446-40c7-a767-619bafcd553f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:33.621731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 315/619] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:33.627029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf1ca9-f36a-4fa0-ae21-07c31bd20f5b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:33.627322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf1ca9-f36a-4fa0-ae21-07c31bd20f5b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:33.627645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf1ca9-f36a-4fa0-ae21-07c31bd20f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:33.649137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:33.649936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-bdcf1ca9-f36a-4fa0-ae21-07c31bd20f5b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:33.651604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bdcf1ca9-f36a-4fa0-ae21-07c31bd20f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:33.737695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 316/620] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:33.816306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4446da0-f9c3-4db5-9427-f6858822746c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:33.873640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57d945-f6c9-4229-9009-7b47b10288aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:33.875028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57d945-f6c9-4229-9009-7b47b10288aa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:33.875707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57d945-f6c9-4229-9009-7b47b10288aa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:33.876366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57d945-f6c9-4229-9009-7b47b10288aa None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:33.877759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57d945-f6c9-4229-9009-7b47b10288aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:33.878525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57d945-f6c9-4229-9009-7b47b10288aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:33.881211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57d945-f6c9-4229-9009-7b47b10288aa None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:33.901370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 305/621] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:33.903326 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf1ca9-f36a-4fa0-ae21-07c31bd20f5b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:33.939151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:34.033901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf1ca9-f36a-4fa0-ae21-07c31bd20f5b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:34.073525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd207826-61f0-4cd2-8cfe-553aa198c2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:34.074182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd207826-61f0-4cd2-8cfe-553aa198c2a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:34.074465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd207826-61f0-4cd2-8cfe-553aa198c2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:34.074737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd207826-61f0-4cd2-8cfe-553aa198c2a0 None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/e20585b86c2d45da8ca53fa1db2ccd25/roles/e564a081239e4e48a6b6257c8cec5e4d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:34.087247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57d945-f6c9-4229-9009-7b47b10288aa None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:34.098592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd207826-61f0-4cd2-8cfe-553aa198c2a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=e20585b86c2d45da8ca53fa1db2ccd25, role_id=e564a081239e4e48a6b6257c8cec5e4d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:34.100056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd207826-61f0-4cd2-8cfe-553aa198c2a0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:34.119740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 317/622] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:12:33 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/e20585b86c2d45da8ca53fa1db2ccd25/roles/e564a081239e4e48a6b6257c8cec5e4d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:12:34.242747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:34.272654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57d945-f6c9-4229-9009-7b47b10288aa None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:34.321317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adaa35-fddc-4012-a3dd-e82c4bf840e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:34.321968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adaa35-fddc-4012-a3dd-e82c4bf840e0 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:34.322251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adaa35-fddc-4012-a3dd-e82c4bf840e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:34.322526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adaa35-fddc-4012-a3dd-e82c4bf840e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:34.340654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adaa35-fddc-4012-a3dd-e82c4bf840e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-f1adaa35-fddc-4012-a3dd-e82c4bf840e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:34.345990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:34.346906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:34.347741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 306/623] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:34.353457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd207826-61f0-4cd2-8cfe-553aa198c2a0 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:34.407589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf0cab-a36f-4854-83d4-486d1734de7f None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:34.407915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf0cab-a36f-4854-83d4-486d1734de7f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:34.408152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf0cab-a36f-4854-83d4-486d1734de7f None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:34.410357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 307/624] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:34.419202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9094de-476a-437a-8beb-c9d332a9c5db None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:34.419509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9094de-476a-437a-8beb-c9d332a9c5db None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:34.419756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9094de-476a-437a-8beb-c9d332a9c5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:34.444199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1d9094de-476a-437a-8beb-c9d332a9c5db None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:34.445474 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1d9094de-476a-437a-8beb-c9d332a9c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:34.465113 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:34.503451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd207826-61f0-4cd2-8cfe-553aa198c2a0 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:34.527061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 308/625] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:34.552779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff5a1e-14b2-40b5-8a52-49aa2c0da513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:34.553766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff5a1e-14b2-40b5-8a52-49aa2c0da513 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:34.554242 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff5a1e-14b2-40b5-8a52-49aa2c0da513 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:34.554652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff5a1e-14b2-40b5-8a52-49aa2c0da513 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:34.555773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff5a1e-14b2-40b5-8a52-49aa2c0da513 None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:34.556293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff5a1e-14b2-40b5-8a52-49aa2c0da513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:34.558855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff5a1e-14b2-40b5-8a52-49aa2c0da513 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:34.572648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 318/626] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:34.578351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9094de-476a-437a-8beb-c9d332a9c5db None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:34.685967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:34.714793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9094de-476a-437a-8beb-c9d332a9c5db None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:34.754969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d427e-8af5-420d-a941-25bc26d3ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:34.755625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d427e-8af5-420d-a941-25bc26d3ecaa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:34.755908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d427e-8af5-420d-a941-25bc26d3ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:34.756182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d427e-8af5-420d-a941-25bc26d3ecaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:34.774274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d427e-8af5-420d-a941-25bc26d3ecaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:34.775744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d427e-8af5-420d-a941-25bc26d3ecaa None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-462d427e-8af5-420d-a941-25bc26d3ecaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:34.791873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:34.792936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:34.794477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:34.794477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:34.794477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:34.794477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 309/627] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:34.798787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff5a1e-14b2-40b5-8a52-49aa2c0da513 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:34.814718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6485f-585a-482f-8ca4-6e70b56bb806 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:34.815346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6485f-585a-482f-8ca4-6e70b56bb806 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:34.815817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6485f-585a-482f-8ca4-6e70b56bb806 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:34.818758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 310/628] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:34.823506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a3541-173c-490e-b27f-324b3e447c57 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:34.824067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a3541-173c-490e-b27f-324b3e447c57 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:34.824536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a3541-173c-490e-b27f-324b3e447c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:34.844829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-677a3541-173c-490e-b27f-324b3e447c57 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:34.846795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-677a3541-173c-490e-b27f-324b3e447c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:34.941340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 311/629] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:34.941340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a3541-173c-490e-b27f-324b3e447c57 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:35.022961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff5a1e-14b2-40b5-8a52-49aa2c0da513 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:35.026209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:35.094389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57096ae8-999e-4801-a6cf-d302929743cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:35.095062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57096ae8-999e-4801-a6cf-d302929743cb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.095294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57096ae8-999e-4801-a6cf-d302929743cb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.095566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57096ae8-999e-4801-a6cf-d302929743cb None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.096226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57096ae8-999e-4801-a6cf-d302929743cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:35.096531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57096ae8-999e-4801-a6cf-d302929743cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:35.098170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57096ae8-999e-4801-a6cf-d302929743cb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:35.100351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:35.108352 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a3541-173c-490e-b27f-324b3e447c57 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:35.126467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 319/630] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:35.133420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57096ae8-999e-4801-a6cf-d302929743cb None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:35.189696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023211c-c49e-4ee8-a88c-7926916dde89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:35.190353 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023211c-c49e-4ee8-a88c-7926916dde89 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.190631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023211c-c49e-4ee8-a88c-7926916dde89 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.190905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023211c-c49e-4ee8-a88c-7926916dde89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.212272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023211c-c49e-4ee8-a88c-7926916dde89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-a023211c-c49e-4ee8-a88c-7926916dde89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:35.219609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:35.220955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:35.222013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:35.226096 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 312/631] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:35.227034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023211c-c49e-4ee8-a88c-7926916dde89 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:35.302422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57096ae8-999e-4801-a6cf-d302929743cb None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:35.338071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023211c-c49e-4ee8-a88c-7926916dde89 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:35.344628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a529f-85c4-42b4-9ce9-b3cfc04e35b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:35.345292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a529f-85c4-42b4-9ce9-b3cfc04e35b4 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.345574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a529f-85c4-42b4-9ce9-b3cfc04e35b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.346244 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a529f-85c4-42b4-9ce9-b3cfc04e35b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.354129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a529f-85c4-42b4-9ce9-b3cfc04e35b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:35.355423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:35.355536 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a529f-85c4-42b4-9ce9-b3cfc04e35b4 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-f78a529f-85c4-42b4-9ce9-b3cfc04e35b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:35.367646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:35.368893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:35.369873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 320/632] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:35.370471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a529f-85c4-42b4-9ce9-b3cfc04e35b4 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:35.380755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6972d-8270-4050-813e-0d05566c88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:35.381418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6972d-8270-4050-813e-0d05566c88d2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.381700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6972d-8270-4050-813e-0d05566c88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.381975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6972d-8270-4050-813e-0d05566c88d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.393599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6972d-8270-4050-813e-0d05566c88d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-0ab6972d-8270-4050-813e-0d05566c88d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:35.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:35.399396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:35.400219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 313/633] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:35.400909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b8be-8a5d-4234-914a-3e46edb6f3c2 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.400909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b8be-8a5d-4234-914a-3e46edb6f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.401561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b8be-8a5d-4234-914a-3e46edb6f3c2 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.408137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 314/634] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:35.408137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b8be-8a5d-4234-914a-3e46edb6f3c2 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:35.441901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:35.492492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a529f-85c4-42b4-9ce9-b3cfc04e35b4 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:35.527618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b8be-8a5d-4234-914a-3e46edb6f3c2 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:35.528133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7a36c-9138-4ce5-836f-43ed2cba02ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:35.528747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7a36c-9138-4ce5-836f-43ed2cba02ab None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.529031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7a36c-9138-4ce5-836f-43ed2cba02ab None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.529360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7a36c-9138-4ce5-836f-43ed2cba02ab None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.530012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7a36c-9138-4ce5-836f-43ed2cba02ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:35.530321 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7a36c-9138-4ce5-836f-43ed2cba02ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:35.531734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7a36c-9138-4ce5-836f-43ed2cba02ab None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:35.540333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 321/635] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:35.541167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7a36c-9138-4ce5-836f-43ed2cba02ab None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:35.569368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1495ae-2fa7-4b9d-8d57-efe989bd2e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:35.569989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1495ae-2fa7-4b9d-8d57-efe989bd2e62 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.570269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1495ae-2fa7-4b9d-8d57-efe989bd2e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.570544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1495ae-2fa7-4b9d-8d57-efe989bd2e62 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.571276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1495ae-2fa7-4b9d-8d57-efe989bd2e62 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:35.571581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1495ae-2fa7-4b9d-8d57-efe989bd2e62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:35.573009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1495ae-2fa7-4b9d-8d57-efe989bd2e62 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:35.595653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 315/636] 10.222.0.61 () {56 vars in 1137 bytes} [Thu Sep 22 18:12:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:35.595653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9146fb-414e-4cb8-9db5-bb13d174dc85 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.595653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9146fb-414e-4cb8-9db5-bb13d174dc85 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.595653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9146fb-414e-4cb8-9db5-bb13d174dc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.614802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4b9146fb-414e-4cb8-9db5-bb13d174dc85 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:35.616006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4b9146fb-414e-4cb8-9db5-bb13d174dc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:35.648923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:35.667208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7a36c-9138-4ce5-836f-43ed2cba02ab None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:35.686576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:35.696617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 316/637] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:35.705857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9146fb-414e-4cb8-9db5-bb13d174dc85 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:35.719979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608d1d-c540-48a0-8610-89e8d4270ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:35.720693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608d1d-c540-48a0-8610-89e8d4270ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.721045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608d1d-c540-48a0-8610-89e8d4270ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.721704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608d1d-c540-48a0-8610-89e8d4270ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.722985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608d1d-c540-48a0-8610-89e8d4270ed7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:35.723370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608d1d-c540-48a0-8610-89e8d4270ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:35.725252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608d1d-c540-48a0-8610-89e8d4270ed7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:35.735423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 322/638] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:35.736402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608d1d-c540-48a0-8610-89e8d4270ed7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:35.826249 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9146fb-414e-4cb8-9db5-bb13d174dc85 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:35.869201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608d1d-c540-48a0-8610-89e8d4270ed7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:35.875560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050bc03-7078-480d-b3cf-be32db938e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:35.876558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050bc03-7078-480d-b3cf-be32db938e97 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.876844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050bc03-7078-480d-b3cf-be32db938e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.877120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050bc03-7078-480d-b3cf-be32db938e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.893661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050bc03-7078-480d-b3cf-be32db938e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:35.895340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050bc03-7078-480d-b3cf-be32db938e97 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:35.912779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7329d3c-6ce5-44f0-8f96-949498d8fe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:35.913443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7329d3c-6ce5-44f0-8f96-949498d8fe26 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:35.913727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7329d3c-6ce5-44f0-8f96-949498d8fe26 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:35.914001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7329d3c-6ce5-44f0-8f96-949498d8fe26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-c050bc03-7078-480d-b3cf-be32db938e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:35.914100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:35.914965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:35.916087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:35.916087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:35.916087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:35.916087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 317/639] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:35.916312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050bc03-7078-480d-b3cf-be32db938e97 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:35.941349 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:36.020870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:36.062309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7329d3c-6ce5-44f0-8f96-949498d8fe26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:36.064638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7329d3c-6ce5-44f0-8f96-949498d8fe26 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:36.071446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050bc03-7078-480d-b3cf-be32db938e97 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:36.127415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d4eeb-9f3e-4c92-9025-f7e784da0f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:36.128316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d4eeb-9f3e-4c92-9025-f7e784da0f18 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.128768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d4eeb-9f3e-4c92-9025-f7e784da0f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.129225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d4eeb-9f3e-4c92-9025-f7e784da0f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.147478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d4eeb-9f3e-4c92-9025-f7e784da0f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:36.150084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d4eeb-9f3e-4c92-9025-f7e784da0f18 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-812d4eeb-9f3e-4c92-9025-f7e784da0f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:36.174697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:36.176028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:36.178072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:36.178072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:36.178072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:36.178072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 318/640] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:36.178072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d4eeb-9f3e-4c92-9025-f7e784da0f18 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:36.255736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 323/641] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:36.255736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7329d3c-6ce5-44f0-8f96-949498d8fe26 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:36.285278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:36.334535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d4eeb-9f3e-4c92-9025-f7e784da0f18 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:36.357175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:36.373146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d0a8e-7abe-4fe5-9397-d8123aea4fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:36.373796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d0a8e-7abe-4fe5-9397-d8123aea4fbd None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.374072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d0a8e-7abe-4fe5-9397-d8123aea4fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.374379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d0a8e-7abe-4fe5-9397-d8123aea4fbd None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.375225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d0a8e-7abe-4fe5-9397-d8123aea4fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:36.375330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d0a8e-7abe-4fe5-9397-d8123aea4fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:36.376670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d0a8e-7abe-4fe5-9397-d8123aea4fbd None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:36.381277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7329d3c-6ce5-44f0-8f96-949498d8fe26 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:36.389849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 319/642] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:36.390479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d0a8e-7abe-4fe5-9397-d8123aea4fbd None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:36.422238 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4fa6f-0813-4ca3-809a-67e512205462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:36.422879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4fa6f-0813-4ca3-809a-67e512205462 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.423157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4fa6f-0813-4ca3-809a-67e512205462 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.423430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4fa6f-0813-4ca3-809a-67e512205462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.434171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4fa6f-0813-4ca3-809a-67e512205462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-b0b4fa6f-0813-4ca3-809a-67e512205462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:36.438972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:36.440248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 324/643] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:36.441111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4fa6f-0813-4ca3-809a-67e512205462 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:36.515807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d0a8e-7abe-4fe5-9397-d8123aea4fbd None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:36.545086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:36.554297 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15bf7e-4122-4942-9278-287ca8489795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:36.554920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15bf7e-4122-4942-9278-287ca8489795 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.555208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15bf7e-4122-4942-9278-287ca8489795 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.555503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15bf7e-4122-4942-9278-287ca8489795 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.556613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15bf7e-4122-4942-9278-287ca8489795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:36.556916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15bf7e-4122-4942-9278-287ca8489795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:36.558334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15bf7e-4122-4942-9278-287ca8489795 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:36.568901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4fa6f-0813-4ca3-809a-67e512205462 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:36.571587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 320/644] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:36.572426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15bf7e-4122-4942-9278-287ca8489795 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:36.610930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596a528-7770-4054-8f8f-a5a8167f2d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:36.611568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596a528-7770-4054-8f8f-a5a8167f2d75 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.611847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596a528-7770-4054-8f8f-a5a8167f2d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.612118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596a528-7770-4054-8f8f-a5a8167f2d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.619541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:36.625258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596a528-7770-4054-8f8f-a5a8167f2d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:36.626703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596a528-7770-4054-8f8f-a5a8167f2d75 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-2596a528-7770-4054-8f8f-a5a8167f2d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:36.641801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:36.642828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:36.643882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:36.643882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:36.643882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:36.643882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 325/645] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:36.643882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596a528-7770-4054-8f8f-a5a8167f2d75 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:36.681173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15bf7e-4122-4942-9278-287ca8489795 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:36.715479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffff24c-535f-485e-8edf-48f4e568ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:36.716117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffff24c-535f-485e-8edf-48f4e568ddfa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.716400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffff24c-535f-485e-8edf-48f4e568ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.716677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffff24c-535f-485e-8edf-48f4e568ddfa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.724828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffff24c-535f-485e-8edf-48f4e568ddfa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:36.726335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffff24c-535f-485e-8edf-48f4e568ddfa None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-dffff24c-535f-485e-8edf-48f4e568ddfa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:36.737515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:36.738572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 321/646] 10.222.0.61 () {56 vars in 1093 bytes} [Thu Sep 22 18:12:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:36.739867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffff24c-535f-485e-8edf-48f4e568ddfa None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:36.751295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596a528-7770-4054-8f8f-a5a8167f2d75 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:36.785850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4b3ff-8789-49e1-b16f-8dc4c3747a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:36.786463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4b3ff-8789-49e1-b16f-8dc4c3747a86 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.786744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4b3ff-8789-49e1-b16f-8dc4c3747a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.787011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4b3ff-8789-49e1-b16f-8dc4c3747a86 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.787675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4b3ff-8789-49e1-b16f-8dc4c3747a86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:36.787980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4b3ff-8789-49e1-b16f-8dc4c3747a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:36.789373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4b3ff-8789-49e1-b16f-8dc4c3747a86 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:36.792345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:36.797500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 326/647] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:36.798703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aee8d2-b4a6-44ad-a253-230889b54871 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.798990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aee8d2-b4a6-44ad-a253-230889b54871 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.799266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aee8d2-b4a6-44ad-a253-230889b54871 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.800484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 327/648] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:36.805329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aee8d2-b4a6-44ad-a253-230889b54871 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:36.844148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffff24c-535f-485e-8edf-48f4e568ddfa None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:36.859816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:36.878780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d01a1-5b31-4e2f-979d-af4a0cea4496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:36.879421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d01a1-5b31-4e2f-979d-af4a0cea4496 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.879805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d01a1-5b31-4e2f-979d-af4a0cea4496 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.879985 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d01a1-5b31-4e2f-979d-af4a0cea4496 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.887616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d01a1-5b31-4e2f-979d-af4a0cea4496 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:36.889055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d01a1-5b31-4e2f-979d-af4a0cea4496 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-d58d01a1-5b31-4e2f-979d-af4a0cea4496 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:36.900921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:36.902902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 322/649] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:36.904252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d01a1-5b31-4e2f-979d-af4a0cea4496 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:36.917275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aee8d2-b4a6-44ad-a253-230889b54871 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:36.950258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca1fb-3963-4811-80fd-b4364cdb2192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:36.950868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca1fb-3963-4811-80fd-b4364cdb2192 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.951141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca1fb-3963-4811-80fd-b4364cdb2192 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.951418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca1fb-3963-4811-80fd-b4364cdb2192 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.952045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca1fb-3963-4811-80fd-b4364cdb2192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:36.952836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca1fb-3963-4811-80fd-b4364cdb2192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:36.954234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca1fb-3963-4811-80fd-b4364cdb2192 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:36.965968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 328/650] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:36.967165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66657ca4-d2ce-4fc2-8baa-7a5aad288b61 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:36.967453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66657ca4-d2ce-4fc2-8baa-7a5aad288b61 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:36.967716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66657ca4-d2ce-4fc2-8baa-7a5aad288b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:36.985834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-66657ca4-d2ce-4fc2-8baa-7a5aad288b61 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:36.987035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-66657ca4-d2ce-4fc2-8baa-7a5aad288b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:37.006066 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d01a1-5b31-4e2f-979d-af4a0cea4496 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:37.014749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:37.041877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3481b10-b5df-4943-b53b-e575e632893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:37.042494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3481b10-b5df-4943-b53b-e575e632893a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:37.042773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3481b10-b5df-4943-b53b-e575e632893a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:37.043044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3481b10-b5df-4943-b53b-e575e632893a None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:37.043775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3481b10-b5df-4943-b53b-e575e632893a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:37.044079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3481b10-b5df-4943-b53b-e575e632893a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:37.045539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3481b10-b5df-4943-b53b-e575e632893a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:37.055809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 329/651] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:37.056657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66657ca4-d2ce-4fc2-8baa-7a5aad288b61 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:37.064106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 323/652] 10.222.0.61 () {56 vars in 1133 bytes} [Thu Sep 22 18:12:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:37.064918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3481b10-b5df-4943-b53b-e575e632893a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:37.123403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:37.196925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3481b10-b5df-4943-b53b-e575e632893a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:37.197666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66657ca4-d2ce-4fc2-8baa-7a5aad288b61 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:37.236595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddcd30-fa1b-49b0-b6c8-cb43d025106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:37.237709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddcd30-fa1b-49b0-b6c8-cb43d025106c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:37.238314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddcd30-fa1b-49b0-b6c8-cb43d025106c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:37.238710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddcd30-fa1b-49b0-b6c8-cb43d025106c None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:37.239466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddcd30-fa1b-49b0-b6c8-cb43d025106c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:37.239772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddcd30-fa1b-49b0-b6c8-cb43d025106c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:37.241282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddcd30-fa1b-49b0-b6c8-cb43d025106c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:37.252278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c61ca0-b77c-4f59-9518-ec1901978348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:37.252943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c61ca0-b77c-4f59-9518-ec1901978348 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:37.253226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c61ca0-b77c-4f59-9518-ec1901978348 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:37.253523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c61ca0-b77c-4f59-9518-ec1901978348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:37.261111 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 324/653] 10.222.0.61 () {56 vars in 1137 bytes} [Thu Sep 22 18:12:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:37.262014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddcd30-fa1b-49b0-b6c8-cb43d025106c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:37.271163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c61ca0-b77c-4f59-9518-ec1901978348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:37.273305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c61ca0-b77c-4f59-9518-ec1901978348 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:37.290659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-b4c61ca0-b77c-4f59-9518-ec1901978348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:37.301527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:37.302492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:37.303455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:37.303455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:37.303455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:37.303455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 330/654] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:37.304957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c61ca0-b77c-4f59-9518-ec1901978348 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:37.389170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddcd30-fa1b-49b0-b6c8-cb43d025106c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:37.428735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f5d1f-280a-4dbc-a8f6-a97251adeb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:37.429802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5d1f-280a-4dbc-a8f6-a97251adeb7b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:37.430270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5d1f-280a-4dbc-a8f6-a97251adeb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:37.430660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5d1f-280a-4dbc-a8f6-a97251adeb7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:37.440247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f5d1f-280a-4dbc-a8f6-a97251adeb7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:37.442490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f5d1f-280a-4dbc-a8f6-a97251adeb7b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:37.454199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-811f5d1f-280a-4dbc-a8f6-a97251adeb7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:37.460296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:37.461363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:37.462633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:37.462633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:37.462633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:37.462633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:37.462633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:37.462633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:37.462633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:37.462633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:37.465445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 325/655] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:37.466448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f5d1f-280a-4dbc-a8f6-a97251adeb7b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:37.468231 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c61ca0-b77c-4f59-9518-ec1901978348 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:37.515813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ff0b7-1fbf-4746-b4c2-3b0274f9cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:37.516455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ff0b7-1fbf-4746-b4c2-3b0274f9cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:37.516734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ff0b7-1fbf-4746-b4c2-3b0274f9cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:37.517005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ff0b7-1fbf-4746-b4c2-3b0274f9cdc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:37.568802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:37.587637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f5d1f-280a-4dbc-a8f6-a97251adeb7b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:37.622434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ff0b7-1fbf-4746-b4c2-3b0274f9cdc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:37.623174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1c24c-006e-42f7-bbf2-4104353a23db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:37.623791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1c24c-006e-42f7-bbf2-4104353a23db None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:37.624075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1c24c-006e-42f7-bbf2-4104353a23db None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:37.624357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1c24c-006e-42f7-bbf2-4104353a23db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:37.625131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ff0b7-1fbf-4746-b4c2-3b0274f9cdc7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:37.700154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1c24c-006e-42f7-bbf2-4104353a23db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:37.701640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1c24c-006e-42f7-bbf2-4104353a23db None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:37.741465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:37.751364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 331/656] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:37.752103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ff0b7-1fbf-4746-b4c2-3b0274f9cdc7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:37.795160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:37.812764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 326/657] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:37.813697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1c24c-006e-42f7-bbf2-4104353a23db None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:37.858504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ff0b7-1fbf-4746-b4c2-3b0274f9cdc7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:37.892748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a5936-ba46-481a-8e59-079302fc1c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:37.893388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a5936-ba46-481a-8e59-079302fc1c17 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:37.893675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a5936-ba46-481a-8e59-079302fc1c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:37.893945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a5936-ba46-481a-8e59-079302fc1c17 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:37.894584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a5936-ba46-481a-8e59-079302fc1c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:37.894886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a5936-ba46-481a-8e59-079302fc1c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:37.896238 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a5936-ba46-481a-8e59-079302fc1c17 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:37.906997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 332/658] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:37.907787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a5936-ba46-481a-8e59-079302fc1c17 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:37.924213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1c24c-006e-42f7-bbf2-4104353a23db None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:37.961962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ad275-3621-4754-ad4d-2f6e99f4177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:37.962621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ad275-3621-4754-ad4d-2f6e99f4177a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:37.962929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ad275-3621-4754-ad4d-2f6e99f4177a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:37.963208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ad275-3621-4754-ad4d-2f6e99f4177a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:37.969800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:37.974613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ad275-3621-4754-ad4d-2f6e99f4177a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ba8ad275-3621-4754-ad4d-2f6e99f4177a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:37.979720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:37.980792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 327/659] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:37.981681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ad275-3621-4754-ad4d-2f6e99f4177a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.020217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a5936-ba46-481a-8e59-079302fc1c17 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.030315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:38.053933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0d3f4-95a3-4b45-a1cc-95f8c65753c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.054547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0d3f4-95a3-4b45-a1cc-95f8c65753c0 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.054829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0d3f4-95a3-4b45-a1cc-95f8c65753c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.055109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0d3f4-95a3-4b45-a1cc-95f8c65753c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.055805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0d3f4-95a3-4b45-a1cc-95f8c65753c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:38.056110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0d3f4-95a3-4b45-a1cc-95f8c65753c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.057566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0d3f4-95a3-4b45-a1cc-95f8c65753c0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.070348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 333/660] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:38.071151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0d3f4-95a3-4b45-a1cc-95f8c65753c0 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.091728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ad275-3621-4754-ad4d-2f6e99f4177a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.125205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bf4e8-0bd4-489e-9b00-338072c4fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.125856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bf4e8-0bd4-489e-9b00-338072c4fe39 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.126129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bf4e8-0bd4-489e-9b00-338072c4fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.126401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bf4e8-0bd4-489e-9b00-338072c4fe39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.136531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bf4e8-0bd4-489e-9b00-338072c4fe39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.137988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bf4e8-0bd4-489e-9b00-338072c4fe39 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-a63bf4e8-0bd4-489e-9b00-338072c4fe39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:38.152412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:38.153569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:38.154658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:38.154658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:38.154658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:38.154658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 328/661] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:38.154658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bf4e8-0bd4-489e-9b00-338072c4fe39 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.172880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0d3f4-95a3-4b45-a1cc-95f8c65753c0 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.187725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:38.208207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816ef1-2f3b-4c81-b388-97ef0f9a6215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.208849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816ef1-2f3b-4c81-b388-97ef0f9a6215 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.209133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816ef1-2f3b-4c81-b388-97ef0f9a6215 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.209453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e816ef1-2f3b-4c81-b388-97ef0f9a6215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.219741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e816ef1-2f3b-4c81-b388-97ef0f9a6215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.221187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e816ef1-2f3b-4c81-b388-97ef0f9a6215 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-9e816ef1-2f3b-4c81-b388-97ef0f9a6215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:38.236812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:38.238162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:38.239161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:38.239161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:38.239161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:38.239161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 334/662] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:38.239161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816ef1-2f3b-4c81-b388-97ef0f9a6215 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.257406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:38.263724 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bf4e8-0bd4-489e-9b00-338072c4fe39 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.298267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5c043-bc84-4018-9306-493c6c0e95d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.298801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5c043-bc84-4018-9306-493c6c0e95d4 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.299081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5c043-bc84-4018-9306-493c6c0e95d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.299359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5c043-bc84-4018-9306-493c6c0e95d4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.306963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5c043-bc84-4018-9306-493c6c0e95d4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.308395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5c043-bc84-4018-9306-493c6c0e95d4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-f1a5c043-bc84-4018-9306-493c6c0e95d4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:38.321047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:38.322200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:38.323200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 329/663] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:38.323823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5c043-bc84-4018-9306-493c6c0e95d4 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.346528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e816ef1-2f3b-4c81-b388-97ef0f9a6215 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.380031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a7f1c-6c03-4bbe-9e99-d9c824a87f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.380618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a7f1c-6c03-4bbe-9e99-d9c824a87f40 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.380900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a7f1c-6c03-4bbe-9e99-d9c824a87f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.381182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a7f1c-6c03-4bbe-9e99-d9c824a87f40 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.381871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a7f1c-6c03-4bbe-9e99-d9c824a87f40 None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:38.382182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a7f1c-6c03-4bbe-9e99-d9c824a87f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.383558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a7f1c-6c03-4bbe-9e99-d9c824a87f40 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.392222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 335/664] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:38.393015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a7f1c-6c03-4bbe-9e99-d9c824a87f40 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.420697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:38.428516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5c043-bc84-4018-9306-493c6c0e95d4 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.463548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e4f78-4f92-4261-bb86-30c5448ce56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.464221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e4f78-4f92-4261-bb86-30c5448ce56f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.464502 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e4f78-4f92-4261-bb86-30c5448ce56f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.464832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e4f78-4f92-4261-bb86-30c5448ce56f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.465597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e4f78-4f92-4261-bb86-30c5448ce56f None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=465cff05c2ed4fe19e99289379c2966d) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:38.465993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e4f78-4f92-4261-bb86-30c5448ce56f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.467333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e4f78-4f92-4261-bb86-30c5448ce56f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.473908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 330/665] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/role_assignments?user.id=465cff05c2ed4fe19e99289379c2966d&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:38.474680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e4f78-4f92-4261-bb86-30c5448ce56f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.503503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:38.508029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a7f1c-6c03-4bbe-9e99-d9c824a87f40 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.555223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5de5b-3f6a-4c1b-9f75-d7574ff40f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.555822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5de5b-3f6a-4c1b-9f75-d7574ff40f7a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.556053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5de5b-3f6a-4c1b-9f75-d7574ff40f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.556331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5de5b-3f6a-4c1b-9f75-d7574ff40f7a None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.556995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5de5b-3f6a-4c1b-9f75-d7574ff40f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:38.557332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5de5b-3f6a-4c1b-9f75-d7574ff40f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.558782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5de5b-3f6a-4c1b-9f75-d7574ff40f7a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.574395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 336/666] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:38.575078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5de5b-3f6a-4c1b-9f75-d7574ff40f7a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.602236 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e4f78-4f92-4261-bb86-30c5448ce56f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.640191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed455fe-b4c3-4ce8-8694-901fe81c2de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.640816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed455fe-b4c3-4ce8-8694-901fe81c2de8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.641205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed455fe-b4c3-4ce8-8694-901fe81c2de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.641428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed455fe-b4c3-4ce8-8694-901fe81c2de8 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.642088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed455fe-b4c3-4ce8-8694-901fe81c2de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:38.642391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed455fe-b4c3-4ce8-8694-901fe81c2de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.643774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed455fe-b4c3-4ce8-8694-901fe81c2de8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.661870 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 331/667] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:38.662806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed455fe-b4c3-4ce8-8694-901fe81c2de8 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.681593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:38.695381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5de5b-3f6a-4c1b-9f75-d7574ff40f7a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.736291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688272e-e8af-480b-af00-f6bf43494ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.736912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688272e-e8af-480b-af00-f6bf43494ecb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.737192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688272e-e8af-480b-af00-f6bf43494ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.737495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688272e-e8af-480b-af00-f6bf43494ecb None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.738222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688272e-e8af-480b-af00-f6bf43494ecb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:38.738528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688272e-e8af-480b-af00-f6bf43494ecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.739955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688272e-e8af-480b-af00-f6bf43494ecb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.758397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 337/668] 10.222.0.61 () {56 vars in 1139 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:38.759562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688272e-e8af-480b-af00-f6bf43494ecb None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.766649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:38.787185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed455fe-b4c3-4ce8-8694-901fe81c2de8 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.823088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e815c1-80ce-43e2-9e1e-79918d9dd6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.823718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e815c1-80ce-43e2-9e1e-79918d9dd6da None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.824074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e815c1-80ce-43e2-9e1e-79918d9dd6da None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.824355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e815c1-80ce-43e2-9e1e-79918d9dd6da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.835813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e815c1-80ce-43e2-9e1e-79918d9dd6da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.837558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e815c1-80ce-43e2-9e1e-79918d9dd6da None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-10e815c1-80ce-43e2-9e1e-79918d9dd6da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:38.854525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:38.855534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:38.856426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:38.856426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:38.856426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:38.861158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 332/669] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:38.862086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e815c1-80ce-43e2-9e1e-79918d9dd6da None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.876416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688272e-e8af-480b-af00-f6bf43494ecb None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:38.914965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2349fc1-2ea3-4e36-b2f0-074a51c30458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:38.916013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2349fc1-2ea3-4e36-b2f0-074a51c30458 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:38.916759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2349fc1-2ea3-4e36-b2f0-074a51c30458 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:38.917201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2349fc1-2ea3-4e36-b2f0-074a51c30458 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:38.924740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2349fc1-2ea3-4e36-b2f0-074a51c30458 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:38.926218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2349fc1-2ea3-4e36-b2f0-074a51c30458 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-a2349fc1-2ea3-4e36-b2f0-074a51c30458 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:38.938149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:38.939064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:38.939963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:38.939963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:38.939963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:38.939963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:38.939963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:38.939963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:38.939963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:38.939963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:38.939963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 338/670] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:38.940442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2349fc1-2ea3-4e36-b2f0-074a51c30458 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:38.950279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:38.976789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e815c1-80ce-43e2-9e1e-79918d9dd6da None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.010746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:39.017895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607e8a-5bff-4710-9980-66494f5639d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.018543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607e8a-5bff-4710-9980-66494f5639d4 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.018851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607e8a-5bff-4710-9980-66494f5639d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.019130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607e8a-5bff-4710-9980-66494f5639d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.026264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68607e8a-5bff-4710-9980-66494f5639d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.027748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68607e8a-5bff-4710-9980-66494f5639d4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-68607e8a-5bff-4710-9980-66494f5639d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:39.040346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:39.041530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 333/671] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:39.042433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607e8a-5bff-4710-9980-66494f5639d4 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:39.061631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2349fc1-2ea3-4e36-b2f0-074a51c30458 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.100257 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb50b8-25f9-4752-b7ef-1e1655bd239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.100950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb50b8-25f9-4752-b7ef-1e1655bd239b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.101379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb50b8-25f9-4752-b7ef-1e1655bd239b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.101748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb50b8-25f9-4752-b7ef-1e1655bd239b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.158511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607e8a-5bff-4710-9980-66494f5639d4 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.181020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb50b8-25f9-4752-b7ef-1e1655bd239b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.182579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb50b8-25f9-4752-b7ef-1e1655bd239b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:39.191959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:39.194727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ef8ce-d082-4ee9-9d80-ca246351792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.195414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef8ce-d082-4ee9-9d80-ca246351792d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.195771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef8ce-d082-4ee9-9d80-ca246351792d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.196103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef8ce-d082-4ee9-9d80-ca246351792d None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.196822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ef8ce-d082-4ee9-9d80-ca246351792d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:39.197201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ef8ce-d082-4ee9-9d80-ca246351792d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.198673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ef8ce-d082-4ee9-9d80-ca246351792d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:39.212382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 334/672] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:39.217475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ef8ce-d082-4ee9-9d80-ca246351792d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:39.280399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:39.314825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 339/673] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:39.314825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb50b8-25f9-4752-b7ef-1e1655bd239b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:39.338071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ef8ce-d082-4ee9-9d80-ca246351792d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.380079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b72a8e-c33f-4652-a4c2-32e0745a591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.380613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b72a8e-c33f-4652-a4c2-32e0745a591d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.380899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b72a8e-c33f-4652-a4c2-32e0745a591d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.381173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b72a8e-c33f-4652-a4c2-32e0745a591d None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.381913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b72a8e-c33f-4652-a4c2-32e0745a591d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:39.382218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b72a8e-c33f-4652-a4c2-32e0745a591d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.383671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b72a8e-c33f-4652-a4c2-32e0745a591d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:39.404432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 335/674] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:39.404432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b72a8e-c33f-4652-a4c2-32e0745a591d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:39.433469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb50b8-25f9-4752-b7ef-1e1655bd239b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.442216 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:39.471690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094157-1332-4418-ab64-5f82952e5561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.472305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094157-1332-4418-ab64-5f82952e5561 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.472586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094157-1332-4418-ab64-5f82952e5561 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.472861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094157-1332-4418-ab64-5f82952e5561 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.473595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094157-1332-4418-ab64-5f82952e5561 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:39.473908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094157-1332-4418-ab64-5f82952e5561 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.475384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094157-1332-4418-ab64-5f82952e5561 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:39.493386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 340/675] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:39.493386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094157-1332-4418-ab64-5f82952e5561 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:39.511544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b72a8e-c33f-4652-a4c2-32e0745a591d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.528839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:39.553507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecadef-6c34-4a1b-9d04-b188611641f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.554178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecadef-6c34-4a1b-9d04-b188611641f7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.554460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecadef-6c34-4a1b-9d04-b188611641f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.554777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecadef-6c34-4a1b-9d04-b188611641f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.563275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecadef-6c34-4a1b-9d04-b188611641f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.564741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecadef-6c34-4a1b-9d04-b188611641f7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-a0ecadef-6c34-4a1b-9d04-b188611641f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:39.578189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:39.579145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:39.580063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:39.581957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 336/676] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:39.582891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecadef-6c34-4a1b-9d04-b188611641f7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:39.625368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094157-1332-4418-ab64-5f82952e5561 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.674888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fef2e-f7ef-4cf5-898d-0e98b7177f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.675641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fef2e-f7ef-4cf5-898d-0e98b7177f61 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.675937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fef2e-f7ef-4cf5-898d-0e98b7177f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.676224 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fef2e-f7ef-4cf5-898d-0e98b7177f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.688907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fef2e-f7ef-4cf5-898d-0e98b7177f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.690639 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fef2e-f7ef-4cf5-898d-0e98b7177f61 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-0e1fef2e-f7ef-4cf5-898d-0e98b7177f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:39.705125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:39.706131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:39.707011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:39.707011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:39.707011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:39.707011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 341/677] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:39.707244 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fef2e-f7ef-4cf5-898d-0e98b7177f61 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:39.720183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecadef-6c34-4a1b-9d04-b188611641f7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.731695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:39.757671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622d590-9db1-4c47-88aa-53e2d98a6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.758292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622d590-9db1-4c47-88aa-53e2d98a6675 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.758573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622d590-9db1-4c47-88aa-53e2d98a6675 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.758844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622d590-9db1-4c47-88aa-53e2d98a6675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.759586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622d590-9db1-4c47-88aa-53e2d98a6675 None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=d710bb85a200419aa071e119976115c6) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:39.759889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622d590-9db1-4c47-88aa-53e2d98a6675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.761347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622d590-9db1-4c47-88aa-53e2d98a6675 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:39.767386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 337/678] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:39 2022] GET /identity/v3/role_assignments?user.id=d710bb85a200419aa071e119976115c6&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:39.768555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622d590-9db1-4c47-88aa-53e2d98a6675 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:39.830832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:39.851497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fef2e-f7ef-4cf5-898d-0e98b7177f61 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.902475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159cc7b-9673-448f-9cdd-ed64f654bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.903789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159cc7b-9673-448f-9cdd-ed64f654bfec None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.904263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159cc7b-9673-448f-9cdd-ed64f654bfec None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.904693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159cc7b-9673-448f-9cdd-ed64f654bfec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.905651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159cc7b-9673-448f-9cdd-ed64f654bfec None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=2ab45d09f8724d9ca5b6fb1fa050fdf1) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:39.906124 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159cc7b-9673-448f-9cdd-ed64f654bfec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.908644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159cc7b-9673-448f-9cdd-ed64f654bfec None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:39.918203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 342/679] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:39 2022] GET /identity/v3/role_assignments?user.id=2ab45d09f8724d9ca5b6fb1fa050fdf1&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:39.919344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159cc7b-9673-448f-9cdd-ed64f654bfec None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:39.920272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622d590-9db1-4c47-88aa-53e2d98a6675 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:39.975733 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af2f6d-b8a9-4539-8ab8-7000cbe904d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:39.976629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2f6d-b8a9-4539-8ab8-7000cbe904d3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:39.977075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2f6d-b8a9-4539-8ab8-7000cbe904d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:39.977697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2f6d-b8a9-4539-8ab8-7000cbe904d3 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:39.978612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2f6d-b8a9-4539-8ab8-7000cbe904d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:39.979382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2f6d-b8a9-4539-8ab8-7000cbe904d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:39.981967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2f6d-b8a9-4539-8ab8-7000cbe904d3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:40.009789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 338/680] 10.222.0.61 () {56 vars in 1135 bytes} [Thu Sep 22 18:12:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:40.015832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af2f6d-b8a9-4539-8ab8-7000cbe904d3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:40.068370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:40.098903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159cc7b-9673-448f-9cdd-ed64f654bfec None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:40.148726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f9bab-9b0f-4c13-86e8-57124f3a5f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:40.149664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f9bab-9b0f-4c13-86e8-57124f3a5f53 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:40.150382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f9bab-9b0f-4c13-86e8-57124f3a5f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:40.150815 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f9bab-9b0f-4c13-86e8-57124f3a5f53 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:40.151900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f9bab-9b0f-4c13-86e8-57124f3a5f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:40.152824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f9bab-9b0f-4c13-86e8-57124f3a5f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:40.154556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f9bab-9b0f-4c13-86e8-57124f3a5f53 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:40.155050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:40.162876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af2f6d-b8a9-4539-8ab8-7000cbe904d3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:40.172311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 343/681] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:40.178465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f9bab-9b0f-4c13-86e8-57124f3a5f53 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:40.209681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa22ac5-b2be-4dbe-a3f3-419f44445e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:40.210310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa22ac5-b2be-4dbe-a3f3-419f44445e39 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:40.210595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa22ac5-b2be-4dbe-a3f3-419f44445e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:40.210867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa22ac5-b2be-4dbe-a3f3-419f44445e39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:40.305208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f9bab-9b0f-4c13-86e8-57124f3a5f53 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:40.315513 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa22ac5-b2be-4dbe-a3f3-419f44445e39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:40.317810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa22ac5-b2be-4dbe-a3f3-419f44445e39 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:40.349381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11094abe-6f16-4506-af47-47ca1281f4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:40.350408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11094abe-6f16-4506-af47-47ca1281f4ed None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:40.350895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11094abe-6f16-4506-af47-47ca1281f4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:40.351649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11094abe-6f16-4506-af47-47ca1281f4ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:40.360781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11094abe-6f16-4506-af47-47ca1281f4ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:40.363548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11094abe-6f16-4506-af47-47ca1281f4ed None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-11094abe-6f16-4506-af47-47ca1281f4ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:40.384208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:40.385156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:40.386089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:40.386089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:40.386089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:40.386089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:40.386089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:40.386089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:40.386089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:40.386089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:40.386527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 344/682] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:40.394174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11094abe-6f16-4506-af47-47ca1281f4ed None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:40.401577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:40.473008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:40.483211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 339/683] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 18:12:40.489639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa22ac5-b2be-4dbe-a3f3-419f44445e39 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:40.609699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11094abe-6f16-4506-af47-47ca1281f4ed None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:40.666909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa22ac5-b2be-4dbe-a3f3-419f44445e39 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:40.680436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06bb9a-8c98-4ed6-a7a6-7196e09e8372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:40.681080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06bb9a-8c98-4ed6-a7a6-7196e09e8372 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:40.681417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06bb9a-8c98-4ed6-a7a6-7196e09e8372 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:40.681667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06bb9a-8c98-4ed6-a7a6-7196e09e8372 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:40.682383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06bb9a-8c98-4ed6-a7a6-7196e09e8372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:40.682694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06bb9a-8c98-4ed6-a7a6-7196e09e8372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:40.684184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06bb9a-8c98-4ed6-a7a6-7196e09e8372 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:40.699195 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 345/684] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:40.705105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06bb9a-8c98-4ed6-a7a6-7196e09e8372 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:40.740150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1118e-8633-4c54-a020-410fda6f0202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:40.740798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1118e-8633-4c54-a020-410fda6f0202 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:40.741081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1118e-8633-4c54-a020-410fda6f0202 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:40.741390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1118e-8633-4c54-a020-410fda6f0202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:40.757901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1118e-8633-4c54-a020-410fda6f0202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:40.759361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1118e-8633-4c54-a020-410fda6f0202 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-0ce1118e-8633-4c54-a020-410fda6f0202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:40.788916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:40.789989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:40.790880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:40.790880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:40.790880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:40.795833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 340/685] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:40.800868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1118e-8633-4c54-a020-410fda6f0202 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:40.824412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:40.859654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:40.880178 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06bb9a-8c98-4ed6-a7a6-7196e09e8372 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:40.923440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1118e-8633-4c54-a020-410fda6f0202 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:40.924532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b5ca7-714b-4937-a013-d9fb0ab9acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:40.925156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b5ca7-714b-4937-a013-d9fb0ab9acd3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:40.925484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b5ca7-714b-4937-a013-d9fb0ab9acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:40.925762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b5ca7-714b-4937-a013-d9fb0ab9acd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:40.926600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b5ca7-714b-4937-a013-d9fb0ab9acd3 None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=8d0b8fc336694043a34f007b78c45c4a) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:40.926922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b5ca7-714b-4937-a013-d9fb0ab9acd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:40.928517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b5ca7-714b-4937-a013-d9fb0ab9acd3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:40.939876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 346/686] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:40 2022] GET /identity/v3/role_assignments?user.id=8d0b8fc336694043a34f007b78c45c4a&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:40.941811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28accb-9b45-400d-a580-2f21ef5cac64 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:40.942096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28accb-9b45-400d-a580-2f21ef5cac64 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:40.942366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28accb-9b45-400d-a580-2f21ef5cac64 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:40.944204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 347/687] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:40.960383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb23a7-6831-45e4-9202-4c65c2b1bcfd None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:40.960721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb23a7-6831-45e4-9202-4c65c2b1bcfd None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:40.960947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb23a7-6831-45e4-9202-4c65c2b1bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:40.970036 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517daed5-66b7-48c6-ae7f-1d5492294d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:40.971093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517daed5-66b7-48c6-ae7f-1d5492294d3f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:40.971591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517daed5-66b7-48c6-ae7f-1d5492294d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:40.972109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517daed5-66b7-48c6-ae7f-1d5492294d3f None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:40.973010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517daed5-66b7-48c6-ae7f-1d5492294d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:40.973570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517daed5-66b7-48c6-ae7f-1d5492294d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:40.975184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517daed5-66b7-48c6-ae7f-1d5492294d3f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:40.993508 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 341/688] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:40.995858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517daed5-66b7-48c6-ae7f-1d5492294d3f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:41.001526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-39bb23a7-6831-45e4-9202-4c65c2b1bcfd None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:41.002051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-39bb23a7-6831-45e4-9202-4c65c2b1bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:41.107881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517daed5-66b7-48c6-ae7f-1d5492294d3f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:41.116866 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:41.144844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 348/689] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:41.162794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b03ab-9a20-4be2-a082-4fea5001defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:41.163849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b03ab-9a20-4be2-a082-4fea5001defa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:41.164346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b03ab-9a20-4be2-a082-4fea5001defa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:41.164867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b03ab-9a20-4be2-a082-4fea5001defa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:41.177352 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b03ab-9a20-4be2-a082-4fea5001defa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:41.179374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b03ab-9a20-4be2-a082-4fea5001defa None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-043b03ab-9a20-4be2-a082-4fea5001defa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:41.198357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:41.199407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:41.200441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:41.200441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:41.200441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:41.200441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:41.200441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:41.200441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:41.200441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:41.200441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:41.207573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 342/690] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:41.214334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb23a7-6831-45e4-9202-4c65c2b1bcfd None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:41.278402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:41.327968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb23a7-6831-45e4-9202-4c65c2b1bcfd None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:41.373316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e0f81-3e04-49e6-8f2e-df3b82c4c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:41.373935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e0f81-3e04-49e6-8f2e-df3b82c4c648 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:41.374305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e0f81-3e04-49e6-8f2e-df3b82c4c648 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:41.375037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e0f81-3e04-49e6-8f2e-df3b82c4c648 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:41.375731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e0f81-3e04-49e6-8f2e-df3b82c4c648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:41.376031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e0f81-3e04-49e6-8f2e-df3b82c4c648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:41.377484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e0f81-3e04-49e6-8f2e-df3b82c4c648 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:41.389938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 349/691] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:41.396292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b03ab-9a20-4be2-a082-4fea5001defa None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:41.526521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b03ab-9a20-4be2-a082-4fea5001defa None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:41.536464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e0f81-3e04-49e6-8f2e-df3b82c4c648 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:41.583435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc69c5-6b00-4ad8-b8c3-df275b472d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:41.584067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc69c5-6b00-4ad8-b8c3-df275b472d24 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:41.584350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc69c5-6b00-4ad8-b8c3-df275b472d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:41.584624 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc69c5-6b00-4ad8-b8c3-df275b472d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:41.585474 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc69c5-6b00-4ad8-b8c3-df275b472d24 None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=e20585b86c2d45da8ca53fa1db2ccd25) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:41.585789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc69c5-6b00-4ad8-b8c3-df275b472d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:41.587554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc69c5-6b00-4ad8-b8c3-df275b472d24 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:41.603511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 343/692] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:41 2022] GET /identity/v3/role_assignments?user.id=e20585b86c2d45da8ca53fa1db2ccd25&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:41.669918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e0f81-3e04-49e6-8f2e-df3b82c4c648 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:41.701622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:41.715258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55653e2e-be88-42d4-b78b-12ed99c571d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:41.715930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55653e2e-be88-42d4-b78b-12ed99c571d8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:41.716210 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55653e2e-be88-42d4-b78b-12ed99c571d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:41.716484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55653e2e-be88-42d4-b78b-12ed99c571d8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:41.717079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55653e2e-be88-42d4-b78b-12ed99c571d8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:41.718551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55653e2e-be88-42d4-b78b-12ed99c571d8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-55653e2e-be88-42d4-b78b-12ed99c571d8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:41.738910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:41.740005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:41.741332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 350/693] 10.222.0.61 () {56 vars in 1129 bytes} [Thu Sep 22 18:12:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:41.748400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc69c5-6b00-4ad8-b8c3-df275b472d24 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:41.819543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:41.907591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc69c5-6b00-4ad8-b8c3-df275b472d24 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:41.950444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c8186-afb4-442a-8446-d6a49c8c764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:41.951428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c8186-afb4-442a-8446-d6a49c8c764e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:41.951948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c8186-afb4-442a-8446-d6a49c8c764e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:41.952659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c8186-afb4-442a-8446-d6a49c8c764e None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:41.953630 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c8186-afb4-442a-8446-d6a49c8c764e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:41.954205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c8186-afb4-442a-8446-d6a49c8c764e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:41.955893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c8186-afb4-442a-8446-d6a49c8c764e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:41.963427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 344/694] 10.222.0.61 () {56 vars in 1124 bytes} [Thu Sep 22 18:12:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:41.969519 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55653e2e-be88-42d4-b78b-12ed99c571d8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:42.087956 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55653e2e-be88-42d4-b78b-12ed99c571d8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:42.127002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fea6e-9dbb-4b47-a79e-5622f3e46f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:42.128119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fea6e-9dbb-4b47-a79e-5622f3e46f3c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:42.128636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fea6e-9dbb-4b47-a79e-5622f3e46f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:42.129126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fea6e-9dbb-4b47-a79e-5622f3e46f3c None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:42.130065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fea6e-9dbb-4b47-a79e-5622f3e46f3c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:42.130595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fea6e-9dbb-4b47-a79e-5622f3e46f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:42.132198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fea6e-9dbb-4b47-a79e-5622f3e46f3c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:42.144363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 351/695] 10.222.0.61 () {56 vars in 1124 bytes} [Thu Sep 22 18:12:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:42.398858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17bab-3171-403d-9c70-1eeb5699b558 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:42.399205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17bab-3171-403d-9c70-1eeb5699b558 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:42.399384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17bab-3171-403d-9c70-1eeb5699b558 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:42.400920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 345/696] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:42.407156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4e944-d44b-4144-b8c5-dcbb1e49862e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:42.407448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4e944-d44b-4144-b8c5-dcbb1e49862e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:42.407727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4e944-d44b-4144-b8c5-dcbb1e49862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:42.430887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-afa4e944-d44b-4144-b8c5-dcbb1e49862e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:42.432102 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-afa4e944-d44b-4144-b8c5-dcbb1e49862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:42.486155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:42.523475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 352/697] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:42.787088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714441-1e59-437e-bb88-dd7198e8ab95 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:42.787419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714441-1e59-437e-bb88-dd7198e8ab95 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:42.787839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714441-1e59-437e-bb88-dd7198e8ab95 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:42.790505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 346/698] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:42.795490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07eb3c-b59a-4bbe-897f-35a790dbf672 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:42.795966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07eb3c-b59a-4bbe-897f-35a790dbf672 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:42.796046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07eb3c-b59a-4bbe-897f-35a790dbf672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:42.819762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3f07eb3c-b59a-4bbe-897f-35a790dbf672 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:42.820951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3f07eb3c-b59a-4bbe-897f-35a790dbf672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:42.907292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27714441-1e59-437e-bb88-dd7198e8ab95 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:42.908488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 353/699] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:43.056184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:43.069753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27714441-1e59-437e-bb88-dd7198e8ab95 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:43.122909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd228c-bd18-4ee1-8ae7-5adb12f87d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:43.123560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd228c-bd18-4ee1-8ae7-5adb12f87d48 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:43.123897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd228c-bd18-4ee1-8ae7-5adb12f87d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:43.124176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd228c-bd18-4ee1-8ae7-5adb12f87d48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:43.136812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd228c-bd18-4ee1-8ae7-5adb12f87d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-a9cd228c-bd18-4ee1-8ae7-5adb12f87d48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:43.142410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:43.143318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:43.144158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:43.148590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 347/700] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:43.150018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07eb3c-b59a-4bbe-897f-35a790dbf672 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:43.273484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd228c-bd18-4ee1-8ae7-5adb12f87d48 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:43.279886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07eb3c-b59a-4bbe-897f-35a790dbf672 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:43.282846 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:43.334972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653d1c3-bc2e-4603-8921-e8fb8e7f847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:43.335510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653d1c3-bc2e-4603-8921-e8fb8e7f847b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:43.335789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653d1c3-bc2e-4603-8921-e8fb8e7f847b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:43.336068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653d1c3-bc2e-4603-8921-e8fb8e7f847b None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:43.336981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653d1c3-bc2e-4603-8921-e8fb8e7f847b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:43.337302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653d1c3-bc2e-4603-8921-e8fb8e7f847b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:43.338677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653d1c3-bc2e-4603-8921-e8fb8e7f847b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:43.359928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 354/701] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:43.364851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653d1c3-bc2e-4603-8921-e8fb8e7f847b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:43.470432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653d1c3-bc2e-4603-8921-e8fb8e7f847b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:43.504951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bf91c-9887-4cd1-9900-118f1c241c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:43.505620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bf91c-9887-4cd1-9900-118f1c241c53 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:43.505896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bf91c-9887-4cd1-9900-118f1c241c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:43.506171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bf91c-9887-4cd1-9900-118f1c241c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:43.509113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd228c-bd18-4ee1-8ae7-5adb12f87d48 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:43.517352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bf91c-9887-4cd1-9900-118f1c241c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:43.518856 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bf91c-9887-4cd1-9900-118f1c241c53 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-9c0bf91c-9887-4cd1-9900-118f1c241c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:43.533010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:43.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:43.535393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:43.535393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:43.535393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:43.535393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 355/702] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:43.541649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bf91c-9887-4cd1-9900-118f1c241c53 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:43.582858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:43.588030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce8ca-ca1e-44ca-a7f0-be674ddd8fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:43.588726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce8ca-ca1e-44ca-a7f0-be674ddd8fcc None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:43.589125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce8ca-ca1e-44ca-a7f0-be674ddd8fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:43.589511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce8ca-ca1e-44ca-a7f0-be674ddd8fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:43.603753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce8ca-ca1e-44ca-a7f0-be674ddd8fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:43.605354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce8ca-ca1e-44ca-a7f0-be674ddd8fcc None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ac2ce8ca-ca1e-44ca-a7f0-be674ddd8fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:43.623138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:43.624872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:43.626030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:43.626030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:43.626030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:43.627475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 348/703] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:43.633462 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce8ca-ca1e-44ca-a7f0-be674ddd8fcc None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:43.648433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:43.753177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bf91c-9887-4cd1-9900-118f1c241c53 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:43.820341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8750a54-63a5-4b8f-b36c-5102e4ac973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:43.821761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750a54-63a5-4b8f-b36c-5102e4ac973f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:43.822369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750a54-63a5-4b8f-b36c-5102e4ac973f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:43.823934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750a54-63a5-4b8f-b36c-5102e4ac973f None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:43.824742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8750a54-63a5-4b8f-b36c-5102e4ac973f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:43.825433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8750a54-63a5-4b8f-b36c-5102e4ac973f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:43.828142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8750a54-63a5-4b8f-b36c-5102e4ac973f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:43.845421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce8ca-ca1e-44ca-a7f0-be674ddd8fcc None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:43.852323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 356/704] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:43.854735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778941d2-5bf6-41af-9bb5-4a1dc0d4572d None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:43.855025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778941d2-5bf6-41af-9bb5-4a1dc0d4572d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:43.855302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778941d2-5bf6-41af-9bb5-4a1dc0d4572d None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:43.856793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 357/705] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:43.861842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778941d2-5bf6-41af-9bb5-4a1dc0d4572d None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:43.896544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd030-89ed-435e-9583-095fb1182597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:43.897165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd030-89ed-435e-9583-095fb1182597 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:43.897538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd030-89ed-435e-9583-095fb1182597 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:43.897744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd030-89ed-435e-9583-095fb1182597 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:43.898450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fd030-89ed-435e-9583-095fb1182597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:43.898754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fd030-89ed-435e-9583-095fb1182597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:43.900129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fd030-89ed-435e-9583-095fb1182597 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:43.913129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 349/706] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:43.918682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01c549-8e5d-4e95-b565-daaca0bff521 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:43.918682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01c549-8e5d-4e95-b565-daaca0bff521 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:43.918682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01c549-8e5d-4e95-b565-daaca0bff521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:43.933404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ba01c549-8e5d-4e95-b565-daaca0bff521 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:43.934603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ba01c549-8e5d-4e95-b565-daaca0bff521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:43.974748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:43.998153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:44.008024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 350/707] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:44.008681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01c549-8e5d-4e95-b565-daaca0bff521 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:44.009471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778941d2-5bf6-41af-9bb5-4a1dc0d4572d None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:44.049890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7d56a-237f-43c8-a9f9-5b40e80dbe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:44.050781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7d56a-237f-43c8-a9f9-5b40e80dbe2d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:44.051236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7d56a-237f-43c8-a9f9-5b40e80dbe2d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:44.051654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7d56a-237f-43c8-a9f9-5b40e80dbe2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:44.060443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7d56a-237f-43c8-a9f9-5b40e80dbe2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:44.062620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7d56a-237f-43c8-a9f9-5b40e80dbe2d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-2ca7d56a-237f-43c8-a9f9-5b40e80dbe2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:44.076428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:44.077873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:44.079020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:44.081837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 358/708] 10.222.0.61 () {56 vars in 1093 bytes} [Thu Sep 22 18:12:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:44.092239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7d56a-237f-43c8-a9f9-5b40e80dbe2d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:44.173734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01c549-8e5d-4e95-b565-daaca0bff521 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:44.230973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2b3f6-0f61-43c7-99d1-747e7d5d2497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:44.231595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2b3f6-0f61-43c7-99d1-747e7d5d2497 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:44.231874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2b3f6-0f61-43c7-99d1-747e7d5d2497 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:44.232145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2b3f6-0f61-43c7-99d1-747e7d5d2497 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:44.232801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2b3f6-0f61-43c7-99d1-747e7d5d2497 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:44.234394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2b3f6-0f61-43c7-99d1-747e7d5d2497 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:44.278383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 351/709] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:12:44 2022] POST /identity/v3/users => generated 254 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:12:44.300392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7d56a-237f-43c8-a9f9-5b40e80dbe2d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:44.355768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcadf8f-ec21-474e-97ac-91ed3181871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:44.356405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcadf8f-ec21-474e-97ac-91ed3181871d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:44.356684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcadf8f-ec21-474e-97ac-91ed3181871d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:44.356953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcadf8f-ec21-474e-97ac-91ed3181871d None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:44.357737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcadf8f-ec21-474e-97ac-91ed3181871d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:44.358086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcadf8f-ec21-474e-97ac-91ed3181871d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:44.360108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcadf8f-ec21-474e-97ac-91ed3181871d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:44.382325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:44.388796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 359/710] 10.222.0.61 () {56 vars in 1133 bytes} [Thu Sep 22 18:12:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:44.395515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2b3f6-0f61-43c7-99d1-747e7d5d2497 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:44.445258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcadf8f-ec21-474e-97ac-91ed3181871d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:44.489840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:44.551195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2b3f6-0f61-43c7-99d1-747e7d5d2497 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:44.597948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcadf8f-ec21-474e-97ac-91ed3181871d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:44.605652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a51cf1-d838-4e15-84c6-0033064d9b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:44.606286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a51cf1-d838-4e15-84c6-0033064d9b4a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:44.606567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a51cf1-d838-4e15-84c6-0033064d9b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:44.606839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a51cf1-d838-4e15-84c6-0033064d9b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:44.650546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841b8e-e8c5-4aca-88c4-ca111dca2c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:44.651211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841b8e-e8c5-4aca-88c4-ca111dca2c33 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:44.651490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841b8e-e8c5-4aca-88c4-ca111dca2c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:44.651763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841b8e-e8c5-4aca-88c4-ca111dca2c33 None admin] PATH_INFO: `/v3/services/network` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:44.652354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c841b8e-e8c5-4aca-88c4-ca111dca2c33 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:44.653756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c841b8e-e8c5-4aca-88c4-ca111dca2c33 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-7c841b8e-e8c5-4aca-88c4-ca111dca2c33 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:44.664381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:44.665463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:44.666302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 360/711] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:44 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:44.672851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841b8e-e8c5-4aca-88c4-ca111dca2c33 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:44.708662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a51cf1-d838-4e15-84c6-0033064d9b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:44.710519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a51cf1-d838-4e15-84c6-0033064d9b4a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:44.747573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:44.772939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:44.813420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841b8e-e8c5-4aca-88c4-ca111dca2c33 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:44.849956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 352/712] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:44.851631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f657a-dfc7-465b-bbd0-457f9103062c None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:44.852130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f657a-dfc7-465b-bbd0-457f9103062c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:44.852612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f657a-dfc7-465b-bbd0-457f9103062c None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:44.854365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 353/713] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:44.858149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56edf8-44c5-4977-9104-3b42977ff454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:44.858850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56edf8-44c5-4977-9104-3b42977ff454 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:44.859138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56edf8-44c5-4977-9104-3b42977ff454 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:44.859414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56edf8-44c5-4977-9104-3b42977ff454 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:44.860010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f657a-dfc7-465b-bbd0-457f9103062c None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:44.860116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56edf8-44c5-4977-9104-3b42977ff454 None admin] RBAC: Adding query filter params (name=network) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:44.860356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56edf8-44c5-4977-9104-3b42977ff454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:44.861770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56edf8-44c5-4977-9104-3b42977ff454 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:44.869270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 361/714] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:12:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:44.870625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3029e3e-912b-483e-aa7d-74b194aea70e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:44.870918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3029e3e-912b-483e-aa7d-74b194aea70e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:44.871199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3029e3e-912b-483e-aa7d-74b194aea70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:44.890820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f3029e3e-912b-483e-aa7d-74b194aea70e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:44.892049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f3029e3e-912b-483e-aa7d-74b194aea70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:44.968397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 362/715] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:44.969174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3029e3e-912b-483e-aa7d-74b194aea70e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:44.993134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f657a-dfc7-465b-bbd0-457f9103062c None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:45.032244 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c8892-0e78-46aa-9fcd-a123f1a71a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:45.032890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c8892-0e78-46aa-9fcd-a123f1a71a7f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.033228 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c8892-0e78-46aa-9fcd-a123f1a71a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.033533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c8892-0e78-46aa-9fcd-a123f1a71a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.041105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:45.045462 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c8892-0e78-46aa-9fcd-a123f1a71a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:45.047067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c8892-0e78-46aa-9fcd-a123f1a71a7f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-c56c8892-0e78-46aa-9fcd-a123f1a71a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:45.062415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:45.063429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:45.064306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:45.064306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:45.064306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:45.068108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 354/716] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:45.069414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c945b2-94ee-48ba-8fd9-4a9492815164 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.069702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c945b2-94ee-48ba-8fd9-4a9492815164 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.069978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c945b2-94ee-48ba-8fd9-4a9492815164 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.073276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 355/717] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:45.073276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c945b2-94ee-48ba-8fd9-4a9492815164 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:45.079675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:45.105979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3029e3e-912b-483e-aa7d-74b194aea70e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:45.142598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fea1f-62d3-40cd-9e55-384d84a6ddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:45.143459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fea1f-62d3-40cd-9e55-384d84a6ddac None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.143894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fea1f-62d3-40cd-9e55-384d84a6ddac None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.144173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fea1f-62d3-40cd-9e55-384d84a6ddac None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.144809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fea1f-62d3-40cd-9e55-384d84a6ddac None admin] RBAC: Adding query filter params (type=network) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:45.145114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fea1f-62d3-40cd-9e55-384d84a6ddac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:45.146542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fea1f-62d3-40cd-9e55-384d84a6ddac None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:45.151498 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 363/718] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:12:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:45.154222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb373e-05b8-4955-aaa8-f3b23f86c671 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.154508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb373e-05b8-4955-aaa8-f3b23f86c671 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.154782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb373e-05b8-4955-aaa8-f3b23f86c671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.181974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-17cb373e-05b8-4955-aaa8-f3b23f86c671 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:45.183927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-17cb373e-05b8-4955-aaa8-f3b23f86c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:45.209551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c945b2-94ee-48ba-8fd9-4a9492815164 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:45.271466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a9d84-6255-48a4-b79c-f5778093fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:45.272024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a9d84-6255-48a4-b79c-f5778093fcff None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.272309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a9d84-6255-48a4-b79c-f5778093fcff None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.272585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a9d84-6255-48a4-b79c-f5778093fcff None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.273272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a9d84-6255-48a4-b79c-f5778093fcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:45.273584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a9d84-6255-48a4-b79c-f5778093fcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:45.275580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a9d84-6255-48a4-b79c-f5778093fcff None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:45.298915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 356/719] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:45.298915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a9d84-6255-48a4-b79c-f5778093fcff None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:45.302894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 364/720] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:45.304274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb373e-05b8-4955-aaa8-f3b23f86c671 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:45.361309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:45.380938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:45.420116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb373e-05b8-4955-aaa8-f3b23f86c671 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:45.430157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a9d84-6255-48a4-b79c-f5778093fcff None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:45.457816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c109fe7-b53b-460f-ae04-b64f0e6178db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:45.458879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c109fe7-b53b-460f-ae04-b64f0e6178db None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.459496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c109fe7-b53b-460f-ae04-b64f0e6178db None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.460038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c109fe7-b53b-460f-ae04-b64f0e6178db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.468803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c109fe7-b53b-460f-ae04-b64f0e6178db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:45.470631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c109fe7-b53b-460f-ae04-b64f0e6178db None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:45.473156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75771adc-58f5-4a68-a685-57d5562bb3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:45.474138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75771adc-58f5-4a68-a685-57d5562bb3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.474424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75771adc-58f5-4a68-a685-57d5562bb3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.474704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75771adc-58f5-4a68-a685-57d5562bb3f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-4c109fe7-b53b-460f-ae04-b64f0e6178db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:45.485620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:45.486554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:45.487485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:45.487485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:45.487485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:45.487485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:45.487485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:45.487485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:45.487485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:45.487485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:45.487898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75771adc-58f5-4a68-a685-57d5562bb3f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:45.491030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 365/721] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-75771adc-58f5-4a68-a685-57d5562bb3f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:45.491163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:45.492004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:45.492855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:45.495756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 357/722] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:45.496834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c109fe7-b53b-460f-ae04-b64f0e6178db None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:45.498534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75771adc-58f5-4a68-a685-57d5562bb3f1 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:45.622426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75771adc-58f5-4a68-a685-57d5562bb3f1 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:45.651527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:45.664448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7904e63-e1fb-420b-a478-a8d20e87b6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:45.665068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7904e63-e1fb-420b-a478-a8d20e87b6eb None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.665408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7904e63-e1fb-420b-a478-a8d20e87b6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.665692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7904e63-e1fb-420b-a478-a8d20e87b6eb None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.667108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7904e63-e1fb-420b-a478-a8d20e87b6eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:45.667521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7904e63-e1fb-420b-a478-a8d20e87b6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:45.669205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7904e63-e1fb-420b-a478-a8d20e87b6eb None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:45.685320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 358/723] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:45.686473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7904e63-e1fb-420b-a478-a8d20e87b6eb None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:45.700906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c109fe7-b53b-460f-ae04-b64f0e6178db None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:45.720491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:45.763825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95716b5-60e9-4d12-81cc-7cafaf2c6d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:45.764443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95716b5-60e9-4d12-81cc-7cafaf2c6d8a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.764717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95716b5-60e9-4d12-81cc-7cafaf2c6d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.765535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95716b5-60e9-4d12-81cc-7cafaf2c6d8a None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.766226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95716b5-60e9-4d12-81cc-7cafaf2c6d8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:45.766529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95716b5-60e9-4d12-81cc-7cafaf2c6d8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:45.767955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95716b5-60e9-4d12-81cc-7cafaf2c6d8a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:45.785385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 366/724] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:45.786315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95716b5-60e9-4d12-81cc-7cafaf2c6d8a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:45.834385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7904e63-e1fb-420b-a478-a8d20e87b6eb None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:45.873687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc1200-1275-4d56-bb1a-74512da7dc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:45.874263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc1200-1275-4d56-bb1a-74512da7dc65 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.874617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc1200-1275-4d56-bb1a-74512da7dc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.874890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc1200-1275-4d56-bb1a-74512da7dc65 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:45.875602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc1200-1275-4d56-bb1a-74512da7dc65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:45.876985 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc1200-1275-4d56-bb1a-74512da7dc65 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:45.895978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 359/725] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:12:45 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:12:45.896875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc1200-1275-4d56-bb1a-74512da7dc65 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:45.921823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95716b5-60e9-4d12-81cc-7cafaf2c6d8a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:45.955061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:45.991595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ea79e-9483-488a-9ffe-7c36ab2672f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:45.993230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea79e-9483-488a-9ffe-7c36ab2672f3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:45.993795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea79e-9483-488a-9ffe-7c36ab2672f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:45.994349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ea79e-9483-488a-9ffe-7c36ab2672f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:46.010283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ea79e-9483-488a-9ffe-7c36ab2672f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:46.012055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ea79e-9483-488a-9ffe-7c36ab2672f3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:46.020635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc1200-1275-4d56-bb1a-74512da7dc65 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-219ea79e-9483-488a-9ffe-7c36ab2672f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:46.034926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:46.036006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:46.037053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:46.037053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:46.037053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:46.039759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 367/726] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:46.046789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ea79e-9483-488a-9ffe-7c36ab2672f3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:46.072442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:46.083273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b5a9-a604-45f4-a788-2d4b97b48126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:46.084345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b5a9-a604-45f4-a788-2d4b97b48126 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:46.084805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b5a9-a604-45f4-a788-2d4b97b48126 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:46.085404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b5a9-a604-45f4-a788-2d4b97b48126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:46.086416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701b5a9-a604-45f4-a788-2d4b97b48126 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=d710bb85a200419aa071e119976115c6) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:46.086753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701b5a9-a604-45f4-a788-2d4b97b48126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:46.088550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701b5a9-a604-45f4-a788-2d4b97b48126 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:46.105472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 360/727] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:45 2022] GET /identity/v3/role_assignments?user.id=d710bb85a200419aa071e119976115c6&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:46.188231 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ea79e-9483-488a-9ffe-7c36ab2672f3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:46.235763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8e9b-f35a-4366-81e8-242b9ea46a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:46.237078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8e9b-f35a-4366-81e8-242b9ea46a35 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:46.237805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8e9b-f35a-4366-81e8-242b9ea46a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:46.238475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8e9b-f35a-4366-81e8-242b9ea46a35 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:46.239548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d8e9b-f35a-4366-81e8-242b9ea46a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:46.240178 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d8e9b-f35a-4366-81e8-242b9ea46a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:46.242098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d8e9b-f35a-4366-81e8-242b9ea46a35 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:46.258724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 368/728] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:46.264119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b5a9-a604-45f4-a788-2d4b97b48126 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:46.384220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b5a9-a604-45f4-a788-2d4b97b48126 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:46.396500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:46.424262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be2780-ba5c-4df2-bcc0-1e8bbbc987fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:46.424910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be2780-ba5c-4df2-bcc0-1e8bbbc987fa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:46.425191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be2780-ba5c-4df2-bcc0-1e8bbbc987fa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:46.425511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be2780-ba5c-4df2-bcc0-1e8bbbc987fa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:46.434826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be2780-ba5c-4df2-bcc0-1e8bbbc987fa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:46.436399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be2780-ba5c-4df2-bcc0-1e8bbbc987fa None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-82be2780-ba5c-4df2-bcc0-1e8bbbc987fa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:46.451230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:46.452245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:46.454744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 361/729] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:46.458938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8e9b-f35a-4366-81e8-242b9ea46a35 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:46.558716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:46.593727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8e9b-f35a-4366-81e8-242b9ea46a35 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:46.644996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263ae3-4199-4193-bb27-183ae5cc8884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:46.646016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263ae3-4199-4193-bb27-183ae5cc8884 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:46.646534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263ae3-4199-4193-bb27-183ae5cc8884 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:46.647033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263ae3-4199-4193-bb27-183ae5cc8884 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:46.648067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68263ae3-4199-4193-bb27-183ae5cc8884 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:46.648639 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68263ae3-4199-4193-bb27-183ae5cc8884 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:46.650502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68263ae3-4199-4193-bb27-183ae5cc8884 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:46.681417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 369/730] 10.222.0.61 () {56 vars in 1135 bytes} [Thu Sep 22 18:12:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:46.686890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be2780-ba5c-4df2-bcc0-1e8bbbc987fa None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:46.838441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be2780-ba5c-4df2-bcc0-1e8bbbc987fa None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:46.885964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26990c9-e423-4774-bc32-0c330fc4a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:46.886587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26990c9-e423-4774-bc32-0c330fc4a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:46.886866 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26990c9-e423-4774-bc32-0c330fc4a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:46.887137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26990c9-e423-4774-bc32-0c330fc4a1e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:46.940441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:46.986986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26990c9-e423-4774-bc32-0c330fc4a1e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:46.988490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26990c9-e423-4774-bc32-0c330fc4a1e0 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:47.107598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 362/731] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:46 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 18:12:47.113682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263ae3-4199-4193-bb27-183ae5cc8884 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:47.148635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329c8e-0e88-4103-891d-cd896daf7972 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:47.148955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329c8e-0e88-4103-891d-cd896daf7972 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:47.149192 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329c8e-0e88-4103-891d-cd896daf7972 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:47.150824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 363/732] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:47.158543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee9ed8-0a11-4068-9b00-89098144b98d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:47.158963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee9ed8-0a11-4068-9b00-89098144b98d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:47.159342 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee9ed8-0a11-4068-9b00-89098144b98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:47.179148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-61ee9ed8-0a11-4068-9b00-89098144b98d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:47.180558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-61ee9ed8-0a11-4068-9b00-89098144b98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:47.231338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263ae3-4199-4193-bb27-183ae5cc8884 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:47.273266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3a85c-9a39-4173-9b35-c282cf2999f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:47.273266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3a85c-9a39-4173-9b35-c282cf2999f4 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:47.273266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3a85c-9a39-4173-9b35-c282cf2999f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:47.273631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3a85c-9a39-4173-9b35-c282cf2999f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:47.275339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:47.286466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3a85c-9a39-4173-9b35-c282cf2999f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:47.288228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3a85c-9a39-4173-9b35-c282cf2999f4 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-89d3a85c-9a39-4173-9b35-c282cf2999f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:47.304715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:47.305788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:47.306665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:47.306665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:47.306665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:47.308795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 370/733] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:47.311665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:47.315878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3a85c-9a39-4173-9b35-c282cf2999f4 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:47.327473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 364/734] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 18:12:47.451131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3a85c-9a39-4173-9b35-c282cf2999f4 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:47.488093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cacf-b352-41ea-ac2f-f679961e7690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:47.489120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cacf-b352-41ea-ac2f-f679961e7690 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:47.489659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cacf-b352-41ea-ac2f-f679961e7690 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:47.490135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cacf-b352-41ea-ac2f-f679961e7690 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:47.491018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cacf-b352-41ea-ac2f-f679961e7690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:47.491528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cacf-b352-41ea-ac2f-f679961e7690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:47.493345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728cacf-b352-41ea-ac2f-f679961e7690 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:47.507902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 371/735] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:47.513877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee9ed8-0a11-4068-9b00-89098144b98d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:47.625865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee9ed8-0a11-4068-9b00-89098144b98d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:47.682018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83055-7537-434f-8a21-f0a07192cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:47.682695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83055-7537-434f-8a21-f0a07192cc1f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:47.682979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83055-7537-434f-8a21-f0a07192cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:47.683252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83055-7537-434f-8a21-f0a07192cc1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:47.683485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cacf-b352-41ea-ac2f-f679961e7690 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:47.691064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83055-7537-434f-8a21-f0a07192cc1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:47.692519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83055-7537-434f-8a21-f0a07192cc1f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-6bc83055-7537-434f-8a21-f0a07192cc1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:47.709300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:47.710328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:47.711264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:47.711264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:47.711264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:47.711264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:47.711264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:47.711264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:47.711264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:47.711264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:47.711264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 365/736] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:47.719120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83055-7537-434f-8a21-f0a07192cc1f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:47.785613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:47.810974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:47.834851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83055-7537-434f-8a21-f0a07192cc1f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:47.879011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bdcba-be54-4b49-923d-9fdfb4f08d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:47.879629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bdcba-be54-4b49-923d-9fdfb4f08d11 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:47.879906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bdcba-be54-4b49-923d-9fdfb4f08d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:47.880176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bdcba-be54-4b49-923d-9fdfb4f08d11 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:47.880874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bdcba-be54-4b49-923d-9fdfb4f08d11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:47.881173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bdcba-be54-4b49-923d-9fdfb4f08d11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:47.882619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bdcba-be54-4b49-923d-9fdfb4f08d11 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:47.906433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 366/737] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:47.914621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bdcba-be54-4b49-923d-9fdfb4f08d11 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:47.940631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cacf-b352-41ea-ac2f-f679961e7690 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:47.987556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f47c1-124c-4acd-bad0-45f613297808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:47.988313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f47c1-124c-4acd-bad0-45f613297808 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:47.988689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f47c1-124c-4acd-bad0-45f613297808 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:47.988971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f47c1-124c-4acd-bad0-45f613297808 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.000363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f47c1-124c-4acd-bad0-45f613297808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-361f47c1-124c-4acd-bad0-45f613297808 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:48.005414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:48.006356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:48.007194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 372/738] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:48.008378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2de05-be26-45f1-9c63-a68247faadd9 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.008378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2de05-be26-45f1-9c63-a68247faadd9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.008632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2de05-be26-45f1-9c63-a68247faadd9 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.010757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 373/739] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:48.014654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2de05-be26-45f1-9c63-a68247faadd9 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:48.041709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bdcba-be54-4b49-923d-9fdfb4f08d11 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:48.068547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:48.092569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdb15c-daac-4596-bf15-fb01c23680d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:48.094219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdb15c-daac-4596-bf15-fb01c23680d1 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.094710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdb15c-daac-4596-bf15-fb01c23680d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.095335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdb15c-daac-4596-bf15-fb01c23680d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.096669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdb15c-daac-4596-bf15-fb01c23680d1 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=e20585b86c2d45da8ca53fa1db2ccd25) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:48.097185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdb15c-daac-4596-bf15-fb01c23680d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:48.098988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdb15c-daac-4596-bf15-fb01c23680d1 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:48.105718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 367/740] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:47 2022] GET /identity/v3/role_assignments?user.id=e20585b86c2d45da8ca53fa1db2ccd25&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:48.107311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b14a-34d7-4362-b348-bb08592eb17b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.107810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b14a-34d7-4362-b348-bb08592eb17b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.108292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b14a-34d7-4362-b348-bb08592eb17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.128346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3dc4b14a-34d7-4362-b348-bb08592eb17b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:48.130051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3dc4b14a-34d7-4362-b348-bb08592eb17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:48.184332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2de05-be26-45f1-9c63-a68247faadd9 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:48.203949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:48.263034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950a62c-cba6-4be5-a60f-154dfe261dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:48.264825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950a62c-cba6-4be5-a60f-154dfe261dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.266076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950a62c-cba6-4be5-a60f-154dfe261dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.267872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950a62c-cba6-4be5-a60f-154dfe261dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.268816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950a62c-cba6-4be5-a60f-154dfe261dc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:48.270413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950a62c-cba6-4be5-a60f-154dfe261dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:48.274777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950a62c-cba6-4be5-a60f-154dfe261dc8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:48.282807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 368/741] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 18:12:48.293703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 374/742] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:48.294917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4b14a-34d7-4362-b348-bb08592eb17b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:48.407180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4b14a-34d7-4362-b348-bb08592eb17b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:48.423078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:48.450416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e4639-1ed0-40f3-8669-7aa94b21a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:48.451116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4639-1ed0-40f3-8669-7aa94b21a52f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.451397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4639-1ed0-40f3-8669-7aa94b21a52f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.451674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4639-1ed0-40f3-8669-7aa94b21a52f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.467536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e4639-1ed0-40f3-8669-7aa94b21a52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:48.469569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e4639-1ed0-40f3-8669-7aa94b21a52f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-fc1e4639-1ed0-40f3-8669-7aa94b21a52f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:48.490030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:48.491031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:48.491923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:48.491923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:48.491923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:48.491923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 369/743] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:48.497031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950a62c-cba6-4be5-a60f-154dfe261dc8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:48.602875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e4639-1ed0-40f3-8669-7aa94b21a52f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:48.691065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950a62c-cba6-4be5-a60f-154dfe261dc8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:48.735516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bd7f1-aaa3-4267-a2f8-245e03674e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:48.736143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd7f1-aaa3-4267-a2f8-245e03674e2d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.736427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd7f1-aaa3-4267-a2f8-245e03674e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.736704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd7f1-aaa3-4267-a2f8-245e03674e2d None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.737379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd7f1-aaa3-4267-a2f8-245e03674e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:48.738055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd7f1-aaa3-4267-a2f8-245e03674e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:48.739527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd7f1-aaa3-4267-a2f8-245e03674e2d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:48.753223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 375/744] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:48.754647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9810f-3055-4794-9358-fbb3b8088d2f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.754940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9810f-3055-4794-9358-fbb3b8088d2f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.755216 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9810f-3055-4794-9358-fbb3b8088d2f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.760619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 376/745] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:48.761781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9810f-3055-4794-9358-fbb3b8088d2f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:48.771181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e4639-1ed0-40f3-8669-7aa94b21a52f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:48.795035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:48.812958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9512b5-bff3-4c37-9988-14f8c9c56aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:48.813976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9512b5-bff3-4c37-9988-14f8c9c56aa3 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.814451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9512b5-bff3-4c37-9988-14f8c9c56aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.814829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9512b5-bff3-4c37-9988-14f8c9c56aa3 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.815604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9512b5-bff3-4c37-9988-14f8c9c56aa3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:48.817067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9512b5-bff3-4c37-9988-14f8c9c56aa3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:48.835403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 370/746] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:12:48 2022] POST /identity/v3/services => generated 240 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:12:48.837387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6c602-ed74-41c8-9680-8f3633db9966 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.837776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6c602-ed74-41c8-9680-8f3633db9966 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.838153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6c602-ed74-41c8-9680-8f3633db9966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:48.876531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-10c6c602-ed74-41c8-9680-8f3633db9966 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:48.880106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-10c6c602-ed74-41c8-9680-8f3633db9966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:48.924415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9810f-3055-4794-9358-fbb3b8088d2f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:48.947295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:48.984270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75c681-ae4e-42cd-8e0f-bd6a88efd36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:48.985266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75c681-ae4e-42cd-8e0f-bd6a88efd36a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:48.985700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75c681-ae4e-42cd-8e0f-bd6a88efd36a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:48.986126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75c681-ae4e-42cd-8e0f-bd6a88efd36a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:49.002075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75c681-ae4e-42cd-8e0f-bd6a88efd36a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:49.003871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75c681-ae4e-42cd-8e0f-bd6a88efd36a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-5f75c681-ae4e-42cd-8e0f-bd6a88efd36a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:49.027835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:49.029070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:12:49.030363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:49.039935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 377/747] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:12:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:49.046023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75c681-ae4e-42cd-8e0f-bd6a88efd36a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:49.077266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 371/748] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:12:49.152785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:49.169382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75c681-ae4e-42cd-8e0f-bd6a88efd36a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:49.175276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaaf97-ff7f-4eb4-af37-83c0303f605e None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:49.175565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaaf97-ff7f-4eb4-af37-83c0303f605e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:49.175844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaaf97-ff7f-4eb4-af37-83c0303f605e None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:49.177485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 372/749] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:49.182689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e87fb6-b771-4f3f-9faa-269cb0ba5b29 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:49.182976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e87fb6-b771-4f3f-9faa-269cb0ba5b29 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:49.183254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e87fb6-b771-4f3f-9faa-269cb0ba5b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:49.207593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-40e87fb6-b771-4f3f-9faa-269cb0ba5b29 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:49.209469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-40e87fb6-b771-4f3f-9faa-269cb0ba5b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:49.210116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd95f-ff78-4542-a611-e34f1651f4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:49.210750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd95f-ff78-4542-a611-e34f1651f4ec None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:49.211033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd95f-ff78-4542-a611-e34f1651f4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:49.211345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd95f-ff78-4542-a611-e34f1651f4ec None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:49.212424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd95f-ff78-4542-a611-e34f1651f4ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:49.212784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd95f-ff78-4542-a611-e34f1651f4ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:49.214405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd95f-ff78-4542-a611-e34f1651f4ec None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:49.235289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 378/750] 10.222.0.61 () {56 vars in 1149 bytes} [Thu Sep 22 18:12:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:49.241718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd95f-ff78-4542-a611-e34f1651f4ec None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:49.302992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 373/751] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:12:49.350517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd95f-ff78-4542-a611-e34f1651f4ec None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:49.388815 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527473-094e-44cf-8eb5-5cc34de70e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:49.389477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527473-094e-44cf-8eb5-5cc34de70e3e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:49.389762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527473-094e-44cf-8eb5-5cc34de70e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:49.390572 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527473-094e-44cf-8eb5-5cc34de70e3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:49.403933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:49.463197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6527473-094e-44cf-8eb5-5cc34de70e3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:49.464684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6527473-094e-44cf-8eb5-5cc34de70e3e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:49.469048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e87fb6-b771-4f3f-9faa-269cb0ba5b29 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:49.571728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 379/752] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:12:49.577209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527473-094e-44cf-8eb5-5cc34de70e3e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:49.626816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:49.642364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:49.680405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e87fb6-b771-4f3f-9faa-269cb0ba5b29 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:49.688615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527473-094e-44cf-8eb5-5cc34de70e3e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:49.719547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc4c1-8eb6-436f-a9fe-26229bae2487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:49.720194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc4c1-8eb6-436f-a9fe-26229bae2487 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:49.720587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc4c1-8eb6-436f-a9fe-26229bae2487 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:49.720871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc4c1-8eb6-436f-a9fe-26229bae2487 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:49.725569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4a95-761b-436a-acaf-535ef077a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:49.726361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4a95-761b-436a-acaf-535ef077a624 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:49.726753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4a95-761b-436a-acaf-535ef077a624 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:49.727135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4a95-761b-436a-acaf-535ef077a624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:49.732902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffc4c1-8eb6-436f-a9fe-26229bae2487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-a8ffc4c1-8eb6-436f-a9fe-26229bae2487 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:49.738242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:49.739338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:49.740468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 374/753] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:49.741351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc4c1-8eb6-436f-a9fe-26229bae2487 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:49.741434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4a95-761b-436a-acaf-535ef077a624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:49.743515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4a95-761b-436a-acaf-535ef077a624 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-14ca4a95-761b-436a-acaf-535ef077a624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:49.766089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:49.767867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:49.768898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:49.768898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:49.768898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:49.774617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 380/754] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:49.774617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4a95-761b-436a-acaf-535ef077a624 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:49.873594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:49.881565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4a95-761b-436a-acaf-535ef077a624 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:49.882655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc4c1-8eb6-436f-a9fe-26229bae2487 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:49.917340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ce533-5cb4-41e8-b768-75b5de98f908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:49.918185 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ce533-5cb4-41e8-b768-75b5de98f908 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:49.918576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ce533-5cb4-41e8-b768-75b5de98f908 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:49.918956 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ce533-5cb4-41e8-b768-75b5de98f908 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:49.919795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ce533-5cb4-41e8-b768-75b5de98f908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:49.920213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ce533-5cb4-41e8-b768-75b5de98f908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:49.921760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ce533-5cb4-41e8-b768-75b5de98f908 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:49.929573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c165df8-e416-4db3-bf2f-3cb83f3a0b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:49.930448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c165df8-e416-4db3-bf2f-3cb83f3a0b8a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:49.930735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c165df8-e416-4db3-bf2f-3cb83f3a0b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:49.931011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c165df8-e416-4db3-bf2f-3cb83f3a0b8a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:49.931651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c165df8-e416-4db3-bf2f-3cb83f3a0b8a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:49.932698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 381/755] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:49.933103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c165df8-e416-4db3-bf2f-3cb83f3a0b8a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:49.933787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ce533-5cb4-41e8-b768-75b5de98f908 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-0c165df8-e416-4db3-bf2f-3cb83f3a0b8a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:49.947776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:49.949003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:49.950031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 375/756] 10.222.0.61 () {56 vars in 1129 bytes} [Thu Sep 22 18:12:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:49.951175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c165df8-e416-4db3-bf2f-3cb83f3a0b8a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:49.980789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:50.064647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ce533-5cb4-41e8-b768-75b5de98f908 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.096346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c165df8-e416-4db3-bf2f-3cb83f3a0b8a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.116232 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c7e11-edd3-487b-ad38-6525432ea715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.117391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c7e11-edd3-487b-ad38-6525432ea715 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.117693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c7e11-edd3-487b-ad38-6525432ea715 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.117978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c7e11-edd3-487b-ad38-6525432ea715 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.118938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c7e11-edd3-487b-ad38-6525432ea715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:50.119254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c7e11-edd3-487b-ad38-6525432ea715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.122464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c7e11-edd3-487b-ad38-6525432ea715 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.140965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdc2cc-18c3-4b78-ae64-e8bc19b901b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.141299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 382/757] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:50.141889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdc2cc-18c3-4b78-ae64-e8bc19b901b8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.142051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c7e11-edd3-487b-ad38-6525432ea715 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.142367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdc2cc-18c3-4b78-ae64-e8bc19b901b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.142778 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdc2cc-18c3-4b78-ae64-e8bc19b901b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.162205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdc2cc-18c3-4b78-ae64-e8bc19b901b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.163682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdc2cc-18c3-4b78-ae64-e8bc19b901b8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.177065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-f2cdc2cc-18c3-4b78-ae64-e8bc19b901b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:50.183729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:50.184712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:50.187057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:50.187057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:50.187057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:50.188305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 376/758] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:50.189859 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdc2cc-18c3-4b78-ae64-e8bc19b901b8 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.265583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:50.273370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c7e11-edd3-487b-ad38-6525432ea715 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.309400 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1ccce-2ac8-440f-8149-e2f2110076e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.310017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1ccce-2ac8-440f-8149-e2f2110076e6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.310296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1ccce-2ac8-440f-8149-e2f2110076e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.310572 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1ccce-2ac8-440f-8149-e2f2110076e6 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.311208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1ccce-2ac8-440f-8149-e2f2110076e6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:50.311510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1ccce-2ac8-440f-8149-e2f2110076e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.313459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdc2cc-18c3-4b78-ae64-e8bc19b901b8 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.313573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1ccce-2ac8-440f-8149-e2f2110076e6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.318590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 383/759] 10.222.0.61 () {56 vars in 1124 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:50.319510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1ccce-2ac8-440f-8149-e2f2110076e6 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.352385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aab0c3-d7bc-40af-afad-9d7004ceb619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.353437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab0c3-d7bc-40af-afad-9d7004ceb619 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.353924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab0c3-d7bc-40af-afad-9d7004ceb619 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.354400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab0c3-d7bc-40af-afad-9d7004ceb619 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.362475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aab0c3-d7bc-40af-afad-9d7004ceb619 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.364324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aab0c3-d7bc-40af-afad-9d7004ceb619 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-09aab0c3-d7bc-40af-afad-9d7004ceb619 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:50.377016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:50.377973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:50.378876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:50.378876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:50.378876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:50.378876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:50.378876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:50.378876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:50.378876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:50.378876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:50.382533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 377/760] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:50.383645 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aab0c3-d7bc-40af-afad-9d7004ceb619 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.411884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:50.434411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1ccce-2ac8-440f-8149-e2f2110076e6 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.465950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db0441-470b-47c1-afa0-3d4701923102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.466934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db0441-470b-47c1-afa0-3d4701923102 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.467235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db0441-470b-47c1-afa0-3d4701923102 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.467615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db0441-470b-47c1-afa0-3d4701923102 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.468972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db0441-470b-47c1-afa0-3d4701923102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:50.469419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db0441-470b-47c1-afa0-3d4701923102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.471069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db0441-470b-47c1-afa0-3d4701923102 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.488308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 384/761] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:50.489522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db0441-470b-47c1-afa0-3d4701923102 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.510068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aab0c3-d7bc-40af-afad-9d7004ceb619 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.535079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:50.549391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779343a-a10e-43ab-8ddb-80a01a70546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.550256 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779343a-a10e-43ab-8ddb-80a01a70546a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.550690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779343a-a10e-43ab-8ddb-80a01a70546a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.551113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779343a-a10e-43ab-8ddb-80a01a70546a None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.551900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779343a-a10e-43ab-8ddb-80a01a70546a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:50.552354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779343a-a10e-43ab-8ddb-80a01a70546a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.553924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779343a-a10e-43ab-8ddb-80a01a70546a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.560508 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 378/762] 10.222.0.61 () {56 vars in 1124 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:50.561695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779343a-a10e-43ab-8ddb-80a01a70546a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.602551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db0441-470b-47c1-afa0-3d4701923102 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.639229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a017-2aa4-44be-a0ef-e2721fda5b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.640137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a017-2aa4-44be-a0ef-e2721fda5b40 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.640558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a017-2aa4-44be-a0ef-e2721fda5b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.640941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a017-2aa4-44be-a0ef-e2721fda5b40 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.641824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a017-2aa4-44be-a0ef-e2721fda5b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:50.642246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a017-2aa4-44be-a0ef-e2721fda5b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.643843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a017-2aa4-44be-a0ef-e2721fda5b40 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.659407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 385/763] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:50.660545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a017-2aa4-44be-a0ef-e2721fda5b40 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.665526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:50.676101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779343a-a10e-43ab-8ddb-80a01a70546a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.716604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd315c7-2b1f-41bf-a406-ff7cd24eef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.717335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd315c7-2b1f-41bf-a406-ff7cd24eef00 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.717623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd315c7-2b1f-41bf-a406-ff7cd24eef00 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.717904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd315c7-2b1f-41bf-a406-ff7cd24eef00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.727219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd315c7-2b1f-41bf-a406-ff7cd24eef00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.728957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd315c7-2b1f-41bf-a406-ff7cd24eef00 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-8fd315c7-2b1f-41bf-a406-ff7cd24eef00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:50.742993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:50.744146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:50.745326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:50.749486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 379/764] 10.222.0.61 () {56 vars in 1093 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:50.750444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd315c7-2b1f-41bf-a406-ff7cd24eef00 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.776255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a017-2aa4-44be-a0ef-e2721fda5b40 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.803689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:50.815428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c91a-c669-41c9-aeea-dd0df93950bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.816043 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c91a-c669-41c9-aeea-dd0df93950bd None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.816324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c91a-c669-41c9-aeea-dd0df93950bd None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.816597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c91a-c669-41c9-aeea-dd0df93950bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.817322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c91a-c669-41c9-aeea-dd0df93950bd None admin] RBAC: Adding query filter params (interface=public, service_id=cfc7a830cc81464889d2f8ce23a26445, region_id=RegionOne) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:50.817634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c91a-c669-41c9-aeea-dd0df93950bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.818998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c91a-c669-41c9-aeea-dd0df93950bd None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.831160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 386/765] 10.222.0.61 () {56 vars in 1251 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/endpoints?service_id=cfc7a830cc81464889d2f8ce23a26445&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:50.831160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c91a-c669-41c9-aeea-dd0df93950bd None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.877311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd315c7-2b1f-41bf-a406-ff7cd24eef00 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:50.896885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:50.916034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f89b6-e77f-4227-859c-048695ccb61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:50.916642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f89b6-e77f-4227-859c-048695ccb61b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.916917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f89b6-e77f-4227-859c-048695ccb61b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.917190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f89b6-e77f-4227-859c-048695ccb61b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.917947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f89b6-e77f-4227-859c-048695ccb61b None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=99c9b7ef3a7345879747a2193ad8044c) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:50.918250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f89b6-e77f-4227-859c-048695ccb61b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:50.919670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f89b6-e77f-4227-859c-048695ccb61b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:50.925180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 380/766] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/role_assignments?user.id=99c9b7ef3a7345879747a2193ad8044c&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:50.926327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27f76-7bd8-42d7-bd3f-41b1211ad6f0 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:50.926607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27f76-7bd8-42d7-bd3f-41b1211ad6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:50.926873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27f76-7bd8-42d7-bd3f-41b1211ad6f0 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:50.928246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 381/767] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:50.933027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c27f76-7bd8-42d7-bd3f-41b1211ad6f0 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:50.960217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c91a-c669-41c9-aeea-dd0df93950bd None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:51.008960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de130bf1-fef8-4555-8597-25ffb15c7ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:51.009646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130bf1-fef8-4555-8597-25ffb15c7ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:51.009970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130bf1-fef8-4555-8597-25ffb15c7ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:51.010301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130bf1-fef8-4555-8597-25ffb15c7ae8 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:51.011184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de130bf1-fef8-4555-8597-25ffb15c7ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:51.011559 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de130bf1-fef8-4555-8597-25ffb15c7ae8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:51.013363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de130bf1-fef8-4555-8597-25ffb15c7ae8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:51.042345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 387/768] 10.222.0.61 () {56 vars in 1133 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:51.043661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de626-96f7-4cba-acb6-e8295eadcdb8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:51.043947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de626-96f7-4cba-acb6-e8295eadcdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:51.044223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de626-96f7-4cba-acb6-e8295eadcdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:51.063471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3e5de626-96f7-4cba-acb6-e8295eadcdb8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:51.064750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3e5de626-96f7-4cba-acb6-e8295eadcdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:51.069048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c27f76-7bd8-42d7-bd3f-41b1211ad6f0 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:51.082492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:51.112957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e09bcc-b2d1-4865-9a77-2cc6a35b6635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:51.113973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e09bcc-b2d1-4865-9a77-2cc6a35b6635 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:51.114397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e09bcc-b2d1-4865-9a77-2cc6a35b6635 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:51.114854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e09bcc-b2d1-4865-9a77-2cc6a35b6635 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:51.115802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e09bcc-b2d1-4865-9a77-2cc6a35b6635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:51.117440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e09bcc-b2d1-4865-9a77-2cc6a35b6635 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:51.124278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 382/769] 10.222.0.61 () {56 vars in 1087 bytes} [Thu Sep 22 18:12:50 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:51.125608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e09bcc-b2d1-4865-9a77-2cc6a35b6635 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:51.148116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 388/770] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:12:51.285894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e09bcc-b2d1-4865-9a77-2cc6a35b6635 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:51.332512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3b6d4-eaf7-4844-9aed-ad3d3c078408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:51.333402 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3b6d4-eaf7-4844-9aed-ad3d3c078408 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:51.333782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3b6d4-eaf7-4844-9aed-ad3d3c078408 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:51.334175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3b6d4-eaf7-4844-9aed-ad3d3c078408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:51.347526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3b6d4-eaf7-4844-9aed-ad3d3c078408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:51.349141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3b6d4-eaf7-4844-9aed-ad3d3c078408 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-aeb3b6d4-eaf7-4844-9aed-ad3d3c078408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:51.364951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:51.366113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:51.367200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:51.367200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:51.367200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:51.372978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 383/771] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:51.374386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5de626-96f7-4cba-acb6-e8295eadcdb8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:51.431537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:51.452133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db0f0-ab13-45d4-ae0e-467e34b4d5e8 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:51.452696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db0f0-ab13-45d4-ae0e-467e34b4d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:51.453127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db0f0-ab13-45d4-ae0e-467e34b4d5e8 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:51.454898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 384/772] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:51.460902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc00041-f36a-4057-afff-b9aaea4f06f1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:51.461183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc00041-f36a-4057-afff-b9aaea4f06f1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:51.461488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc00041-f36a-4057-afff-b9aaea4f06f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:51.490697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-dbc00041-f36a-4057-afff-b9aaea4f06f1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:51.491490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5de626-96f7-4cba-acb6-e8295eadcdb8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:51.492630 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-dbc00041-f36a-4057-afff-b9aaea4f06f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:51.534227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689ea90-b6b1-4211-bb52-9c065fea3174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:51.534853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689ea90-b6b1-4211-bb52-9c065fea3174 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:51.535139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689ea90-b6b1-4211-bb52-9c065fea3174 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:51.535407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689ea90-b6b1-4211-bb52-9c065fea3174 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:51.536121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689ea90-b6b1-4211-bb52-9c065fea3174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:51.536366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689ea90-b6b1-4211-bb52-9c065fea3174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:51.537616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:51.538065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689ea90-b6b1-4211-bb52-9c065fea3174 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:51.551520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 389/773] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:51.552396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689ea90-b6b1-4211-bb52-9c065fea3174 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:51.601392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 385/774] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:12:51.606222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc00041-f36a-4057-afff-b9aaea4f06f1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:51.721501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689ea90-b6b1-4211-bb52-9c065fea3174 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:51.753588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:51.788517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3dc80-5172-4d6a-83dc-eb98e12384bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:51.789094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3dc80-5172-4d6a-83dc-eb98e12384bb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:51.789422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3dc80-5172-4d6a-83dc-eb98e12384bb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:51.789708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3dc80-5172-4d6a-83dc-eb98e12384bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:51.809135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc00041-f36a-4057-afff-b9aaea4f06f1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:51.825818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3dc80-5172-4d6a-83dc-eb98e12384bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-fdf3dc80-5172-4d6a-83dc-eb98e12384bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:51.831469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:51.832500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:51.833546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 390/775] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:51.838973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3dc80-5172-4d6a-83dc-eb98e12384bb None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:51.895336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fc047-353f-43b2-b1b9-8b20dba41562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:51.895991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fc047-353f-43b2-b1b9-8b20dba41562 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:51.896276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fc047-353f-43b2-b1b9-8b20dba41562 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:51.896552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fc047-353f-43b2-b1b9-8b20dba41562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:51.913527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fc047-353f-43b2-b1b9-8b20dba41562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:51.915004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fc047-353f-43b2-b1b9-8b20dba41562 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-cf5fc047-353f-43b2-b1b9-8b20dba41562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:51.928688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:51.929643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 386/776] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:51.930662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fc047-353f-43b2-b1b9-8b20dba41562 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:51.957666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:51.980750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3dc80-5172-4d6a-83dc-eb98e12384bb None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.018622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bcf00-950e-434f-80ec-f2fe058e4bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.019424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bcf00-950e-434f-80ec-f2fe058e4bae None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.019830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bcf00-950e-434f-80ec-f2fe058e4bae None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.020213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bcf00-950e-434f-80ec-f2fe058e4bae None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.020993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bcf00-950e-434f-80ec-f2fe058e4bae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:52.021454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bcf00-950e-434f-80ec-f2fe058e4bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.022991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bcf00-950e-434f-80ec-f2fe058e4bae None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.033096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 391/777] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:52.034070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bcf00-950e-434f-80ec-f2fe058e4bae None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.050902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fc047-353f-43b2-b1b9-8b20dba41562 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.069374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:52.091065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135780d-6da4-4928-a922-c23345c20263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.091911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135780d-6da4-4928-a922-c23345c20263 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.092201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135780d-6da4-4928-a922-c23345c20263 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.092481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135780d-6da4-4928-a922-c23345c20263 None admin] PATH_INFO: `/v3/services/network` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.093260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135780d-6da4-4928-a922-c23345c20263 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.094775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135780d-6da4-4928-a922-c23345c20263 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-9135780d-6da4-4928-a922-c23345c20263 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:52.104488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:52.107070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:52.109294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 387/778] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:51 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:52.118224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135780d-6da4-4928-a922-c23345c20263 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.149720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bcf00-950e-434f-80ec-f2fe058e4bae None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.185810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24174216-eb1d-4e4a-a214-289fa41d38c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.186498 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24174216-eb1d-4e4a-a214-289fa41d38c8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.187306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24174216-eb1d-4e4a-a214-289fa41d38c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.187638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24174216-eb1d-4e4a-a214-289fa41d38c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.188450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24174216-eb1d-4e4a-a214-289fa41d38c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:52.188759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24174216-eb1d-4e4a-a214-289fa41d38c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.190291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24174216-eb1d-4e4a-a214-289fa41d38c8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.204862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 392/779] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:52.205760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24174216-eb1d-4e4a-a214-289fa41d38c8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.219997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:52.247566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135780d-6da4-4928-a922-c23345c20263 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.287720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aeb65-82d2-4bf3-8123-ef8faec7c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.288738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aeb65-82d2-4bf3-8123-ef8faec7c722 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.289210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aeb65-82d2-4bf3-8123-ef8faec7c722 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.289717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aeb65-82d2-4bf3-8123-ef8faec7c722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.302716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4aeb65-82d2-4bf3-8123-ef8faec7c722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.304476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4aeb65-82d2-4bf3-8123-ef8faec7c722 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.311019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:52.318680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24174216-eb1d-4e4a-a214-289fa41d38c8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ef4aeb65-82d2-4bf3-8123-ef8faec7c722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:52.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:52.325490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:52.326383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:52.326383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:52.326383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:52.328331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 388/780] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:52.334008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aeb65-82d2-4bf3-8123-ef8faec7c722 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.355164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863998ea-5bbe-45af-bb2d-59f93059be30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.355762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863998ea-5bbe-45af-bb2d-59f93059be30 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.356049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863998ea-5bbe-45af-bb2d-59f93059be30 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.356325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863998ea-5bbe-45af-bb2d-59f93059be30 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.356971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863998ea-5bbe-45af-bb2d-59f93059be30 None admin] RBAC: Adding query filter params (name=network) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:52.357294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863998ea-5bbe-45af-bb2d-59f93059be30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.359206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863998ea-5bbe-45af-bb2d-59f93059be30 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.368792 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 393/781] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:12:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:52.369696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863998ea-5bbe-45af-bb2d-59f93059be30 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.448872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aeb65-82d2-4bf3-8123-ef8faec7c722 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.477019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863998ea-5bbe-45af-bb2d-59f93059be30 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.482188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:52.489130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940f62-7ae7-42f9-b7d1-91752a29736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.490044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940f62-7ae7-42f9-b7d1-91752a29736a None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.490479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940f62-7ae7-42f9-b7d1-91752a29736a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.490904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940f62-7ae7-42f9-b7d1-91752a29736a None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/d710bb85a200419aa071e119976115c6/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.493493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940f62-7ae7-42f9-b7d1-91752a29736a None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=d710bb85a200419aa071e119976115c6, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.495273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940f62-7ae7-42f9-b7d1-91752a29736a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.510910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 389/782] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:12:52 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/d710bb85a200419aa071e119976115c6/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:12:52.512274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940f62-7ae7-42f9-b7d1-91752a29736a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.514419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe1471-5ad6-416d-9b12-00ea163c9c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.515745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe1471-5ad6-416d-9b12-00ea163c9c6a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.516253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe1471-5ad6-416d-9b12-00ea163c9c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.516763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe1471-5ad6-416d-9b12-00ea163c9c6a None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.517449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe1471-5ad6-416d-9b12-00ea163c9c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:52.517909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe1471-5ad6-416d-9b12-00ea163c9c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.519424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe1471-5ad6-416d-9b12-00ea163c9c6a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.533099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 394/783] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:52.538833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe1471-5ad6-416d-9b12-00ea163c9c6a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.560489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:52.640757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940f62-7ae7-42f9-b7d1-91752a29736a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.657851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe1471-5ad6-416d-9b12-00ea163c9c6a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.681382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155e337-5d3a-4f95-b90c-40bf0f7c32d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.682290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155e337-5d3a-4f95-b90c-40bf0f7c32d7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.682746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155e337-5d3a-4f95-b90c-40bf0f7c32d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.683188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155e337-5d3a-4f95-b90c-40bf0f7c32d7 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.684001 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155e337-5d3a-4f95-b90c-40bf0f7c32d7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:52.684541 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155e337-5d3a-4f95-b90c-40bf0f7c32d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.686170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155e337-5d3a-4f95-b90c-40bf0f7c32d7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.692320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 390/784] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:12:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:52.699157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155e337-5d3a-4f95-b90c-40bf0f7c32d7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.765766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:52.802595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1703fe-86ea-4c1f-935d-727cbff2aee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.803297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1703fe-86ea-4c1f-935d-727cbff2aee6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.803582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1703fe-86ea-4c1f-935d-727cbff2aee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.803862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1703fe-86ea-4c1f-935d-727cbff2aee6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.815040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1703fe-86ea-4c1f-935d-727cbff2aee6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.816323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1703fe-86ea-4c1f-935d-727cbff2aee6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.823299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155e337-5d3a-4f95-b90c-40bf0f7c32d7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-1f1703fe-86ea-4c1f-935d-727cbff2aee6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:52.830016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:52.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:52.832653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:52.834177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 395/785] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:52.840847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1703fe-86ea-4c1f-935d-727cbff2aee6 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.894847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b5baf-c0e6-4719-9193-cc8ac4992651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:52.895723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b5baf-c0e6-4719-9193-cc8ac4992651 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:52.897132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b5baf-c0e6-4719-9193-cc8ac4992651 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:52.898734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b5baf-c0e6-4719-9193-cc8ac4992651 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:52.899628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b5baf-c0e6-4719-9193-cc8ac4992651 None admin] RBAC: Adding query filter params (interface=public, service_id=f938269a0eb64300acf14462681fa95d, region_id=RegionOne) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:52.900812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b5baf-c0e6-4719-9193-cc8ac4992651 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:52.904842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b5baf-c0e6-4719-9193-cc8ac4992651 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:52.915620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 391/786] 10.222.0.61 () {56 vars in 1251 bytes} [Thu Sep 22 18:12:52 2022] GET /identity/v3/endpoints?service_id=f938269a0eb64300acf14462681fa95d&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:52.924619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b5baf-c0e6-4719-9193-cc8ac4992651 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:52.999845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:53.043225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1703fe-86ea-4c1f-935d-727cbff2aee6 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:53.110128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346f25-aa66-4d92-a4a2-4e63baf41e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:53.110669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346f25-aa66-4d92-a4a2-4e63baf41e3e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:53.110952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346f25-aa66-4d92-a4a2-4e63baf41e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:53.111230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82346f25-aa66-4d92-a4a2-4e63baf41e3e None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:53.111967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346f25-aa66-4d92-a4a2-4e63baf41e3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:53.112278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346f25-aa66-4d92-a4a2-4e63baf41e3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:53.113979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82346f25-aa66-4d92-a4a2-4e63baf41e3e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:53.148621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b5baf-c0e6-4719-9193-cc8ac4992651 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:53.158583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 396/787] 10.222.0.61 () {56 vars in 1135 bytes} [Thu Sep 22 18:12:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:53.162490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346f25-aa66-4d92-a4a2-4e63baf41e3e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:53.189654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:53.199388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86461be-c8d2-41f6-bad8-422df1d92c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:53.200083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86461be-c8d2-41f6-bad8-422df1d92c57 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:53.200373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86461be-c8d2-41f6-bad8-422df1d92c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:53.200657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86461be-c8d2-41f6-bad8-422df1d92c57 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:53.201369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86461be-c8d2-41f6-bad8-422df1d92c57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:53.203380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86461be-c8d2-41f6-bad8-422df1d92c57 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:53.209886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 392/788] 10.222.0.61 () {56 vars in 1087 bytes} [Thu Sep 22 18:12:52 2022] GET /identity/v3/services => generated 772 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:53.360352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82346f25-aa66-4d92-a4a2-4e63baf41e3e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:53.403188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ea26a-a8c0-4242-9125-9012b17068fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:53.403857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea26a-a8c0-4242-9125-9012b17068fa None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:53.404139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea26a-a8c0-4242-9125-9012b17068fa None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:53.404412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea26a-a8c0-4242-9125-9012b17068fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:53.410423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:53.419645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ea26a-a8c0-4242-9125-9012b17068fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:53.421831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ea26a-a8c0-4242-9125-9012b17068fa None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-2f4ea26a-a8c0-4242-9125-9012b17068fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:53.438165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:53.439148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:53.440011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:53.440011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:53.440011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:53.440011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 397/789] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:53.444910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86461be-c8d2-41f6-bad8-422df1d92c57 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:53.504128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2580eb-6032-4877-8368-1b5258e262bf None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:53.504663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2580eb-6032-4877-8368-1b5258e262bf None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:53.504663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2580eb-6032-4877-8368-1b5258e262bf None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:53.506296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 398/790] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:53.511283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7f999-005a-43e6-a651-188b3285d521 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:53.511571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7f999-005a-43e6-a651-188b3285d521 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:53.511849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7f999-005a-43e6-a651-188b3285d521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:53.549485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5fc7f999-005a-43e6-a651-188b3285d521 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:53.550689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5fc7f999-005a-43e6-a651-188b3285d521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:53.581043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86461be-c8d2-41f6-bad8-422df1d92c57 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:53.624918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dfd2d-f47e-436a-97f8-0a574fd490b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:53.626199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dfd2d-f47e-436a-97f8-0a574fd490b8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:53.626732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dfd2d-f47e-436a-97f8-0a574fd490b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:53.627451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dfd2d-f47e-436a-97f8-0a574fd490b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:53.628370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dfd2d-f47e-436a-97f8-0a574fd490b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:53.628909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dfd2d-f47e-436a-97f8-0a574fd490b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:53.631160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dfd2d-f47e-436a-97f8-0a574fd490b8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:53.646958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 393/791] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:53.652081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dfd2d-f47e-436a-97f8-0a574fd490b8 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:53.704282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 399/792] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:12:53.745566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d629-099f-4f90-a284-cb36f50abac4 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:53.745884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d629-099f-4f90-a284-cb36f50abac4 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:53.747011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d629-099f-4f90-a284-cb36f50abac4 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:53.750242 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 400/793] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:53.754880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b07d1-c7f1-4f99-a02c-03406d6fb114 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:53.755165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b07d1-c7f1-4f99-a02c-03406d6fb114 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:53.755435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b07d1-c7f1-4f99-a02c-03406d6fb114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:53.767202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:53.777168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d36b07d1-c7f1-4f99-a02c-03406d6fb114 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:53.778546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d36b07d1-c7f1-4f99-a02c-03406d6fb114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:53.857836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dfd2d-f47e-436a-97f8-0a574fd490b8 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:53.894556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 401/794] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:12:53.901461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323e776-ef72-4a3c-b3e3-1291448d5959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:53.902174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e776-ef72-4a3c-b3e3-1291448d5959 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:53.902514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e776-ef72-4a3c-b3e3-1291448d5959 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:53.902795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e776-ef72-4a3c-b3e3-1291448d5959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:53.910995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323e776-ef72-4a3c-b3e3-1291448d5959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:53.912435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323e776-ef72-4a3c-b3e3-1291448d5959 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-6323e776-ef72-4a3c-b3e3-1291448d5959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:53.929322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:53.930253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:53.931181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:53.931181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:53.931181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:53.931181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:53.931181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:53.931181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:53.931181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:53.931181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:53.937641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 394/795] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:53.943524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b07d1-c7f1-4f99-a02c-03406d6fb114 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:54.009728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323e776-ef72-4a3c-b3e3-1291448d5959 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:54.032575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:54.131943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b07d1-c7f1-4f99-a02c-03406d6fb114 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:54.171741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02368ca3-2684-4290-a830-1460025061b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:54.172261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02368ca3-2684-4290-a830-1460025061b9 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:54.172547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02368ca3-2684-4290-a830-1460025061b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:54.172825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02368ca3-2684-4290-a830-1460025061b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:54.173570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02368ca3-2684-4290-a830-1460025061b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:54.173881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02368ca3-2684-4290-a830-1460025061b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:54.175322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02368ca3-2684-4290-a830-1460025061b9 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:54.188148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 402/796] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:54.194638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02368ca3-2684-4290-a830-1460025061b9 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:54.230268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323e776-ef72-4a3c-b3e3-1291448d5959 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:54.251717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:54.281876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134861d-db82-4140-b3cb-9ad7aa1fe6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:54.282518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134861d-db82-4140-b3cb-9ad7aa1fe6fb None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:54.282823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134861d-db82-4140-b3cb-9ad7aa1fe6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:54.283170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134861d-db82-4140-b3cb-9ad7aa1fe6fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:54.294793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134861d-db82-4140-b3cb-9ad7aa1fe6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-5134861d-db82-4140-b3cb-9ad7aa1fe6fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:54.301117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:54.302050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 395/797] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:54.303996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134861d-db82-4140-b3cb-9ad7aa1fe6fb None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:54.326371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02368ca3-2684-4290-a830-1460025061b9 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:54.339572 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:54.375468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaee850-8fa4-477a-b302-8e93c2f1b8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:54.376431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaee850-8fa4-477a-b302-8e93c2f1b8fb None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:54.376859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaee850-8fa4-477a-b302-8e93c2f1b8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:54.377306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaee850-8fa4-477a-b302-8e93c2f1b8fb None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/e20585b86c2d45da8ca53fa1db2ccd25/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:54.379380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaee850-8fa4-477a-b302-8e93c2f1b8fb None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=e20585b86c2d45da8ca53fa1db2ccd25, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:54.381080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaee850-8fa4-477a-b302-8e93c2f1b8fb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:54.397091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 403/798] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:12:54 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/e20585b86c2d45da8ca53fa1db2ccd25/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:12:54.398379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaee850-8fa4-477a-b302-8e93c2f1b8fb None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:54.422030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134861d-db82-4140-b3cb-9ad7aa1fe6fb None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:54.461901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2525ea-b21f-4ba3-b7a2-8c30891ba754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:54.462811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2525ea-b21f-4ba3-b7a2-8c30891ba754 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:54.463098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2525ea-b21f-4ba3-b7a2-8c30891ba754 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:54.463374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2525ea-b21f-4ba3-b7a2-8c30891ba754 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:54.463971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2525ea-b21f-4ba3-b7a2-8c30891ba754 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:54.465374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2525ea-b21f-4ba3-b7a2-8c30891ba754 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-4e2525ea-b21f-4ba3-b7a2-8c30891ba754 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:54.475464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:54.476509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:54.482843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 396/799] 10.222.0.61 () {56 vars in 1129 bytes} [Thu Sep 22 18:12:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:54.490357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2525ea-b21f-4ba3-b7a2-8c30891ba754 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:54.540137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaee850-8fa4-477a-b302-8e93c2f1b8fb None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:54.558623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:54.584590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac3572-901e-44b3-8836-4ff9f72f237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:54.585733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac3572-901e-44b3-8836-4ff9f72f237d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:54.586401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac3572-901e-44b3-8836-4ff9f72f237d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:54.586920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac3572-901e-44b3-8836-4ff9f72f237d None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:54.588085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac3572-901e-44b3-8836-4ff9f72f237d None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:54.588611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac3572-901e-44b3-8836-4ff9f72f237d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:54.590467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac3572-901e-44b3-8836-4ff9f72f237d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:54.602267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 404/800] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:12:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:54.607309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac3572-901e-44b3-8836-4ff9f72f237d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:54.643168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:54.709065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2525ea-b21f-4ba3-b7a2-8c30891ba754 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:54.720521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac3572-901e-44b3-8836-4ff9f72f237d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:54.757270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61887e7-d50e-4b3e-ba48-c3db801e0a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:54.758338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61887e7-d50e-4b3e-ba48-c3db801e0a5e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:54.758883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61887e7-d50e-4b3e-ba48-c3db801e0a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:54.759472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61887e7-d50e-4b3e-ba48-c3db801e0a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:54.773605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee8a12-63e8-4f6b-a4f6-f39179a76668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:54.774632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee8a12-63e8-4f6b-a4f6-f39179a76668 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:54.775123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee8a12-63e8-4f6b-a4f6-f39179a76668 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:54.775629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee8a12-63e8-4f6b-a4f6-f39179a76668 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:54.776488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee8a12-63e8-4f6b-a4f6-f39179a76668 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:54.777016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee8a12-63e8-4f6b-a4f6-f39179a76668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:54.778744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee8a12-63e8-4f6b-a4f6-f39179a76668 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:54.783862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61887e7-d50e-4b3e-ba48-c3db801e0a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:54.785359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61887e7-d50e-4b3e-ba48-c3db801e0a5e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:54.786149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 397/801] 10.222.0.61 () {56 vars in 1124 bytes} [Thu Sep 22 18:12:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:54.791856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee8a12-63e8-4f6b-a4f6-f39179a76668 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-a61887e7-d50e-4b3e-ba48-c3db801e0a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:54.817525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:54.818513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:54.819394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:54.819394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:54.819394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:54.825322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 405/802] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:54.826264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61887e7-d50e-4b3e-ba48-c3db801e0a5e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:54.950687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:54.972738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee8a12-63e8-4f6b-a4f6-f39179a76668 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:55.063015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f2e86-ffb0-43ad-88be-07ec59c6d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:55.063667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f2e86-ffb0-43ad-88be-07ec59c6d598 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.064000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f2e86-ffb0-43ad-88be-07ec59c6d598 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.064275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f2e86-ffb0-43ad-88be-07ec59c6d598 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.064911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f2e86-ffb0-43ad-88be-07ec59c6d598 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:55.065210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f2e86-ffb0-43ad-88be-07ec59c6d598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:55.066599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f2e86-ffb0-43ad-88be-07ec59c6d598 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:55.074206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:55.080671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 398/803] 10.222.0.61 () {56 vars in 1124 bytes} [Thu Sep 22 18:12:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:55.090216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f2e86-ffb0-43ad-88be-07ec59c6d598 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:55.096564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61887e7-d50e-4b3e-ba48-c3db801e0a5e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:55.132725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73450bb-5a85-4829-8eed-ddcbb69c3f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:55.133588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73450bb-5a85-4829-8eed-ddcbb69c3f07 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.133984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73450bb-5a85-4829-8eed-ddcbb69c3f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.134367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73450bb-5a85-4829-8eed-ddcbb69c3f07 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.135121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73450bb-5a85-4829-8eed-ddcbb69c3f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:55.135538 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73450bb-5a85-4829-8eed-ddcbb69c3f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:55.137153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73450bb-5a85-4829-8eed-ddcbb69c3f07 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:55.149825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 406/804] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:55.155118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73450bb-5a85-4829-8eed-ddcbb69c3f07 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:55.316177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73450bb-5a85-4829-8eed-ddcbb69c3f07 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:55.352930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88532396-323c-4097-b2be-5b94df9c39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:55.353639 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88532396-323c-4097-b2be-5b94df9c39c2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.353924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88532396-323c-4097-b2be-5b94df9c39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.354205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88532396-323c-4097-b2be-5b94df9c39c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.363581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88532396-323c-4097-b2be-5b94df9c39c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:55.365027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88532396-323c-4097-b2be-5b94df9c39c2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-88532396-323c-4097-b2be-5b94df9c39c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:55.377720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:55.378731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:55.379655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 407/805] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:12:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:55.384985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88532396-323c-4097-b2be-5b94df9c39c2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:55.389540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:55.481031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f2e86-ffb0-43ad-88be-07ec59c6d598 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:55.497576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88532396-323c-4097-b2be-5b94df9c39c2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:55.519269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6091-bb03-42fe-848e-469bb4afa333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:55.519887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6091-bb03-42fe-848e-469bb4afa333 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.520170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6091-bb03-42fe-848e-469bb4afa333 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.520443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6091-bb03-42fe-848e-469bb4afa333 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.521127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6091-bb03-42fe-848e-469bb4afa333 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:55.522736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6091-bb03-42fe-848e-469bb4afa333 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:55.533544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1698d40-b728-4d43-b929-4ed0bfaaa77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:55.534167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1698d40-b728-4d43-b929-4ed0bfaaa77a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.534448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1698d40-b728-4d43-b929-4ed0bfaaa77a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.534723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1698d40-b728-4d43-b929-4ed0bfaaa77a None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.536044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1698d40-b728-4d43-b929-4ed0bfaaa77a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:55.536333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1698d40-b728-4d43-b929-4ed0bfaaa77a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:55.538284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1698d40-b728-4d43-b929-4ed0bfaaa77a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:55.548721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 399/806] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:12:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:12:55.550354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d8dad-0891-4ce4-ba77-68dc7bbed9bf None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.550888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d8dad-0891-4ce4-ba77-68dc7bbed9bf None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.551393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d8dad-0891-4ce4-ba77-68dc7bbed9bf None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.557509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 400/807] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:55.559226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82967e-fae4-4f31-aa69-22e50a79af4d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.559770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82967e-fae4-4f31-aa69-22e50a79af4d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.560290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82967e-fae4-4f31-aa69-22e50a79af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.572215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 408/808] 10.222.0.61 () {56 vars in 1149 bytes} [Thu Sep 22 18:12:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:55.578437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1698d40-b728-4d43-b929-4ed0bfaaa77a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:55.583030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-5b82967e-fae4-4f31-aa69-22e50a79af4d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:55.584554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5b82967e-fae4-4f31-aa69-22e50a79af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:55.600741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:55.720181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:55.746820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 401/809] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:12:55.779798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1698d40-b728-4d43-b929-4ed0bfaaa77a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:55.819143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b43a6-74bf-4bd9-92b6-7ad1da8e3fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:55.819979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b43a6-74bf-4bd9-92b6-7ad1da8e3fcf None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.820476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b43a6-74bf-4bd9-92b6-7ad1da8e3fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.820847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b43a6-74bf-4bd9-92b6-7ad1da8e3fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.832369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b43a6-74bf-4bd9-92b6-7ad1da8e3fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:55.833789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b43a6-74bf-4bd9-92b6-7ad1da8e3fcf None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-133b43a6-74bf-4bd9-92b6-7ad1da8e3fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:55.851211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:55.852201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:55.853153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:55.853153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:55.853153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:55.853153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 409/810] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:55.859387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82967e-fae4-4f31-aa69-22e50a79af4d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:55.882222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a4b4-9fbd-4321-a4b0-415ab9ec9295 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.882533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a4b4-9fbd-4321-a4b0-415ab9ec9295 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.883177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a4b4-9fbd-4321-a4b0-415ab9ec9295 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.884369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 410/811] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:12:55.889025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23085c30-d95f-4856-b695-b7bc3e8817fc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:55.889572 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23085c30-d95f-4856-b695-b7bc3e8817fc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:55.889857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23085c30-d95f-4856-b695-b7bc3e8817fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:55.910243 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-23085c30-d95f-4856-b695-b7bc3e8817fc None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:55.911878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-23085c30-d95f-4856-b695-b7bc3e8817fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:55.996768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82967e-fae4-4f31-aa69-22e50a79af4d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:56.018098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 411/812] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:12:56.038211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219a4cc-8d87-4658-81cc-db50a96567b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:56.038886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219a4cc-8d87-4658-81cc-db50a96567b8 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:56.039166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219a4cc-8d87-4658-81cc-db50a96567b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:56.039441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219a4cc-8d87-4658-81cc-db50a96567b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:56.040145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219a4cc-8d87-4658-81cc-db50a96567b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:56.040454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219a4cc-8d87-4658-81cc-db50a96567b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:56.041867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219a4cc-8d87-4658-81cc-db50a96567b8 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:56.049189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:56.055566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 402/813] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:56.060660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23085c30-d95f-4856-b695-b7bc3e8817fc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:56.075918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219a4cc-8d87-4658-81cc-db50a96567b8 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:56.153686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:56.274692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219a4cc-8d87-4658-81cc-db50a96567b8 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:56.277488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23085c30-d95f-4856-b695-b7bc3e8817fc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:56.325812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fa179-c2e2-4463-ab76-ce06072f0552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:56.326610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fa179-c2e2-4463-ab76-ce06072f0552 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:56.326893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fa179-c2e2-4463-ab76-ce06072f0552 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:56.327164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fa179-c2e2-4463-ab76-ce06072f0552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:56.337734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fa179-c2e2-4463-ab76-ce06072f0552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:56.339818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fa179-c2e2-4463-ab76-ce06072f0552 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-f60fa179-c2e2-4463-ab76-ce06072f0552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:56.351705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:56.352709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:56.353716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:56.353716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:56.353716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:56.353716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:56.353716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:56.353716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:56.353716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:56.353716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:56.353716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 412/814] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:56.358066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fa179-c2e2-4463-ab76-ce06072f0552 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:56.360368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2c31c-c168-455b-941e-bc2bd3c5b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:56.361293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2c31c-c168-455b-941e-bc2bd3c5b391 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:56.362099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2c31c-c168-455b-941e-bc2bd3c5b391 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:56.363596 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2c31c-c168-455b-941e-bc2bd3c5b391 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:56.378912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2c31c-c168-455b-941e-bc2bd3c5b391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-a2c2c31c-c168-455b-941e-bc2bd3c5b391 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:56.386666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:56.387892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:56.388937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:56.396878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 403/815] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:56.396878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2c31c-c168-455b-941e-bc2bd3c5b391 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:56.477319 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:56.478012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fa179-c2e2-4463-ab76-ce06072f0552 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:56.480119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:56.519837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dd33f-23b3-4e79-9689-bee265e3fb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:56.520236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dd33f-23b3-4e79-9689-bee265e3fb68 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:56.520521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dd33f-23b3-4e79-9689-bee265e3fb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:56.520855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dd33f-23b3-4e79-9689-bee265e3fb68 None admin] PATH_INFO: `/v3/services/network` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:56.521479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dd33f-23b3-4e79-9689-bee265e3fb68 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:56.522900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dd33f-23b3-4e79-9689-bee265e3fb68 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-267dd33f-23b3-4e79-9689-bee265e3fb68 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:56.532439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:56.533527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 18:12:56.534395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:56.537521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 413/816] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:56 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:56.538376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dd33f-23b3-4e79-9689-bee265e3fb68 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:56.543447 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2c31c-c168-455b-941e-bc2bd3c5b391 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:56.597870 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d815c6-14e3-426e-9b53-1fbd4687ab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:56.598991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d815c6-14e3-426e-9b53-1fbd4687ab6b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:56.599446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d815c6-14e3-426e-9b53-1fbd4687ab6b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:56.600194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d815c6-14e3-426e-9b53-1fbd4687ab6b None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:56.601519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d815c6-14e3-426e-9b53-1fbd4687ab6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:56.601997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d815c6-14e3-426e-9b53-1fbd4687ab6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:56.603598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d815c6-14e3-426e-9b53-1fbd4687ab6b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:56.622037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 404/817] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:56.623094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d815c6-14e3-426e-9b53-1fbd4687ab6b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:56.663250 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dd33f-23b3-4e79-9689-bee265e3fb68 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:56.699480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363f3ec-62b5-4f33-a593-0fb5526ba600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:56.700304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363f3ec-62b5-4f33-a593-0fb5526ba600 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:56.700695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363f3ec-62b5-4f33-a593-0fb5526ba600 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:56.701073 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363f3ec-62b5-4f33-a593-0fb5526ba600 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:56.701885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363f3ec-62b5-4f33-a593-0fb5526ba600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:56.702299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363f3ec-62b5-4f33-a593-0fb5526ba600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:56.703837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363f3ec-62b5-4f33-a593-0fb5526ba600 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:56.719325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 414/818] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:56.719325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363f3ec-62b5-4f33-a593-0fb5526ba600 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:56.751818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:56.760936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d815c6-14e3-426e-9b53-1fbd4687ab6b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:56.783616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:56.804360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ff738-7fdb-4b06-9f30-5d9f72554692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:56.805500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ff738-7fdb-4b06-9f30-5d9f72554692 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:56.806015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ff738-7fdb-4b06-9f30-5d9f72554692 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:56.806503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ff738-7fdb-4b06-9f30-5d9f72554692 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:56.807459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ff738-7fdb-4b06-9f30-5d9f72554692 None admin] RBAC: Adding query filter params (name=network) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:56.808010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ff738-7fdb-4b06-9f30-5d9f72554692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:56.809766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ff738-7fdb-4b06-9f30-5d9f72554692 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:56.815855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 405/819] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:12:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:56.816941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ff738-7fdb-4b06-9f30-5d9f72554692 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:56.839028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363f3ec-62b5-4f33-a593-0fb5526ba600 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:56.878955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfb981-2a93-408c-b7cf-fe361f21f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:56.879648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfb981-2a93-408c-b7cf-fe361f21f596 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:56.880030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfb981-2a93-408c-b7cf-fe361f21f596 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:56.880392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfb981-2a93-408c-b7cf-fe361f21f596 None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/99c9b7ef3a7345879747a2193ad8044c/roles/e564a081239e4e48a6b6257c8cec5e4d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:56.897902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfb981-2a93-408c-b7cf-fe361f21f596 None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=99c9b7ef3a7345879747a2193ad8044c, role_id=e564a081239e4e48a6b6257c8cec5e4d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:56.899582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfb981-2a93-408c-b7cf-fe361f21f596 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:56.915318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 415/820] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:12:56 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/99c9b7ef3a7345879747a2193ad8044c/roles/e564a081239e4e48a6b6257c8cec5e4d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:12:56.916150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfb981-2a93-408c-b7cf-fe361f21f596 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:56.949895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ff738-7fdb-4b06-9f30-5d9f72554692 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:57.005971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:57.008656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31309d3-b4ec-4c07-906c-e8aee1669bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:57.011069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31309d3-b4ec-4c07-906c-e8aee1669bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:57.011643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31309d3-b4ec-4c07-906c-e8aee1669bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:57.013368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31309d3-b4ec-4c07-906c-e8aee1669bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:57.029067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31309d3-b4ec-4c07-906c-e8aee1669bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:57.032583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31309d3-b4ec-4c07-906c-e8aee1669bf0 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:57.034313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfb981-2a93-408c-b7cf-fe361f21f596 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-f31309d3-b4ec-4c07-906c-e8aee1669bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:57.053263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:57.054343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:57.055263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:57.055263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:57.055263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:57.059035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 406/821] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:57.060538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1e5c-0fa0-42a6-9bbc-ac8dfdbfafba None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:57.060821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1e5c-0fa0-42a6-9bbc-ac8dfdbfafba None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:57.061274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1e5c-0fa0-42a6-9bbc-ac8dfdbfafba None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:57.062868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 407/822] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:57.063625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1e5c-0fa0-42a6-9bbc-ac8dfdbfafba None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:57.082667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532a223-aa96-40f5-946b-42ff29257931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:57.083771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532a223-aa96-40f5-946b-42ff29257931 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:57.084433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532a223-aa96-40f5-946b-42ff29257931 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:57.085465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532a223-aa96-40f5-946b-42ff29257931 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:57.086744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532a223-aa96-40f5-946b-42ff29257931 None admin] RBAC: Adding query filter params (type=network) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:57.087595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532a223-aa96-40f5-946b-42ff29257931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:57.089299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532a223-aa96-40f5-946b-42ff29257931 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:57.096255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 416/823] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:12:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:57.101908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554a765-c627-4f4d-a0a8-b821588bb347 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:57.102269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554a765-c627-4f4d-a0a8-b821588bb347 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:57.102551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554a765-c627-4f4d-a0a8-b821588bb347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:57.119275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:57.124912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6554a765-c627-4f4d-a0a8-b821588bb347 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:57.126184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6554a765-c627-4f4d-a0a8-b821588bb347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:57.205488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1e5c-0fa0-42a6-9bbc-ac8dfdbfafba None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:57.233323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 417/824] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:12:57.236254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554a765-c627-4f4d-a0a8-b821588bb347 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:57.272330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae6fe-df85-438a-b3c2-a4515c7a09e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:57.273333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae6fe-df85-438a-b3c2-a4515c7a09e5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:57.274501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae6fe-df85-438a-b3c2-a4515c7a09e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:57.274947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae6fe-df85-438a-b3c2-a4515c7a09e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:57.276965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae6fe-df85-438a-b3c2-a4515c7a09e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:57.277466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae6fe-df85-438a-b3c2-a4515c7a09e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:57.282191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae6fe-df85-438a-b3c2-a4515c7a09e5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:57.307175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 408/825] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:57.312580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae6fe-df85-438a-b3c2-a4515c7a09e5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:57.372625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:57.428063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554a765-c627-4f4d-a0a8-b821588bb347 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:57.481223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:57.490504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae6fe-df85-438a-b3c2-a4515c7a09e5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:57.510592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8230a5-3427-409e-8e0d-735b6b51c205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:57.511227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8230a5-3427-409e-8e0d-735b6b51c205 None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:57.511514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8230a5-3427-409e-8e0d-735b6b51c205 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:57.511793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8230a5-3427-409e-8e0d-735b6b51c205 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:57.512471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8230a5-3427-409e-8e0d-735b6b51c205 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:57.513903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8230a5-3427-409e-8e0d-735b6b51c205 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:57.532219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934654d9-3835-4697-b70c-546645a4823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:57.533177 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934654d9-3835-4697-b70c-546645a4823b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:57.533718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934654d9-3835-4697-b70c-546645a4823b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:57.534633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934654d9-3835-4697-b70c-546645a4823b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:57.549130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934654d9-3835-4697-b70c-546645a4823b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:57.551075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934654d9-3835-4697-b70c-546645a4823b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:57.561401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 418/826] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:12:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-934654d9-3835-4697-b70c-546645a4823b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:57.573273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:57.574499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:12:57.575716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:57.577977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 409/827] 10.222.0.61 () {56 vars in 1093 bytes} [Thu Sep 22 18:12:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:57.585337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8230a5-3427-409e-8e0d-735b6b51c205 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:57.591874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934654d9-3835-4697-b70c-546645a4823b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:57.774462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8230a5-3427-409e-8e0d-735b6b51c205 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:57.798483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934654d9-3835-4697-b70c-546645a4823b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:57.802814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:57.815660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee315a-9145-4c3f-a9d1-a197ced0bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:57.816286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee315a-9145-4c3f-a9d1-a197ced0bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:57.816570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee315a-9145-4c3f-a9d1-a197ced0bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:57.816947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee315a-9145-4c3f-a9d1-a197ced0bcf7 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:57.817820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee315a-9145-4c3f-a9d1-a197ced0bcf7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:57.818134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee315a-9145-4c3f-a9d1-a197ced0bcf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:57.819637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee315a-9145-4c3f-a9d1-a197ced0bcf7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:57.841056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 419/828] 10.222.0.61 () {56 vars in 1133 bytes} [Thu Sep 22 18:12:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:57.842328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6975498-714d-49e7-a5bb-4fc1582f692e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:57.842973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6975498-714d-49e7-a5bb-4fc1582f692e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:57.843336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6975498-714d-49e7-a5bb-4fc1582f692e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:57.843605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6975498-714d-49e7-a5bb-4fc1582f692e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:57.849630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee315a-9145-4c3f-a9d1-a197ced0bcf7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:57.855999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6975498-714d-49e7-a5bb-4fc1582f692e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-d6975498-714d-49e7-a5bb-4fc1582f692e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:12:57.863829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:57.864784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:57.865670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 410/829] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:57.872492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6975498-714d-49e7-a5bb-4fc1582f692e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:57.891590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:57.981095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee315a-9145-4c3f-a9d1-a197ced0bcf7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.000916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6975498-714d-49e7-a5bb-4fc1582f692e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.040136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e3664-d7db-471b-85ce-f4104f0bf15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.040772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e3664-d7db-471b-85ce-f4104f0bf15c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.041047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e3664-d7db-471b-85ce-f4104f0bf15c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.041344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e3664-d7db-471b-85ce-f4104f0bf15c None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.041898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598dc92-5f64-4ba8-bf5c-afd79a8cdba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.042045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e3664-d7db-471b-85ce-f4104f0bf15c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:58.042285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e3664-d7db-471b-85ce-f4104f0bf15c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.042516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598dc92-5f64-4ba8-bf5c-afd79a8cdba0 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.042803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598dc92-5f64-4ba8-bf5c-afd79a8cdba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.043076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598dc92-5f64-4ba8-bf5c-afd79a8cdba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.043633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e3664-d7db-471b-85ce-f4104f0bf15c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.052588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 411/830] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:58.058125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e3664-d7db-471b-85ce-f4104f0bf15c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:58.097013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:58.125420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598dc92-5f64-4ba8-bf5c-afd79a8cdba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.128872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598dc92-5f64-4ba8-bf5c-afd79a8cdba0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.150604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:58.182460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e3664-d7db-471b-85ce-f4104f0bf15c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.228796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc72fb2-bfa5-4464-bd48-3836d8e5f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.230043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc72fb2-bfa5-4464-bd48-3836d8e5f789 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.230480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc72fb2-bfa5-4464-bd48-3836d8e5f789 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.231177 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc72fb2-bfa5-4464-bd48-3836d8e5f789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.244524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc72fb2-bfa5-4464-bd48-3836d8e5f789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.245110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 420/831] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:12:58.246486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4564-6b27-47c8-a059-ae5936637e67 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.246838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4564-6b27-47c8-a059-ae5936637e67 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.247177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4564-6b27-47c8-a059-ae5936637e67 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.248712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 421/832] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:58.250915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc72fb2-bfa5-4464-bd48-3836d8e5f789 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.253673 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee4564-6b27-47c8-a059-ae5936637e67 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-bfc72fb2-bfa5-4464-bd48-3836d8e5f789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:58.266299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:58.267281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:58.269275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:58.269275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:58.269275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:58.269275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 412/833] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:58.269275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f06fe-aa4e-4bf1-bcfb-3bb0c23ac30b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.269275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f06fe-aa4e-4bf1-bcfb-3bb0c23ac30b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.269624 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f06fe-aa4e-4bf1-bcfb-3bb0c23ac30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.289333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4e8f06fe-aa4e-4bf1-bcfb-3bb0c23ac30b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:58.290532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4e8f06fe-aa4e-4bf1-bcfb-3bb0c23ac30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:58.350215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:58.369505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 413/834] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:12:58.369505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f06fe-aa4e-4bf1-bcfb-3bb0c23ac30b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:58.379066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee4564-6b27-47c8-a059-ae5936637e67 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.423368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ff9bb-dae9-4478-b443-aa39b4999cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.424013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ff9bb-dae9-4478-b443-aa39b4999cbd None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.424730 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ff9bb-dae9-4478-b443-aa39b4999cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.425069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ff9bb-dae9-4478-b443-aa39b4999cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.437755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ff9bb-dae9-4478-b443-aa39b4999cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.439627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ff9bb-dae9-4478-b443-aa39b4999cbd None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.443683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-f22ff9bb-dae9-4478-b443-aa39b4999cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:58.461443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:58.468685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:58.469627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:58.469627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:58.469627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:58.469627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 422/835] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:58.469627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ff9bb-dae9-4478-b443-aa39b4999cbd None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:58.502273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f06fe-aa4e-4bf1-bcfb-3bb0c23ac30b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.541774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8965-487b-4df5-82a5-4de036677252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.542400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8965-487b-4df5-82a5-4de036677252 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.542682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8965-487b-4df5-82a5-4de036677252 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.542957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8965-487b-4df5-82a5-4de036677252 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.543929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec8965-487b-4df5-82a5-4de036677252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:58.544239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec8965-487b-4df5-82a5-4de036677252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.545911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec8965-487b-4df5-82a5-4de036677252 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.561101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 414/836] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:58.570416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8965-487b-4df5-82a5-4de036677252 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:58.596896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ff9bb-dae9-4478-b443-aa39b4999cbd None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.640049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477d118-c7d6-4d86-bb90-eda45f38aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.640593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477d118-c7d6-4d86-bb90-eda45f38aca8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.640878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477d118-c7d6-4d86-bb90-eda45f38aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.641155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477d118-c7d6-4d86-bb90-eda45f38aca8 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.641902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477d118-c7d6-4d86-bb90-eda45f38aca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:58.642211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477d118-c7d6-4d86-bb90-eda45f38aca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.643763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477d118-c7d6-4d86-bb90-eda45f38aca8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.645492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:58.661397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 423/837] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:12:58.662278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477d118-c7d6-4d86-bb90-eda45f38aca8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:58.701326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8965-487b-4df5-82a5-4de036677252 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.720534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:58.739558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db657366-65ab-4269-ba4d-f806a455a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.740224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db657366-65ab-4269-ba4d-f806a455a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.740507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db657366-65ab-4269-ba4d-f806a455a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.740777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db657366-65ab-4269-ba4d-f806a455a6a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.748662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db657366-65ab-4269-ba4d-f806a455a6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.750153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db657366-65ab-4269-ba4d-f806a455a6a5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-db657366-65ab-4269-ba4d-f806a455a6a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:12:58.761892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:58.762844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 415/838] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:12:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:12:58.763776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db657366-65ab-4269-ba4d-f806a455a6a5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:58.772388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477d118-c7d6-4d86-bb90-eda45f38aca8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.807337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32235c7f-7395-4554-8a24-c78a18338dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.807996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32235c7f-7395-4554-8a24-c78a18338dbe None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.808247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32235c7f-7395-4554-8a24-c78a18338dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.808524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32235c7f-7395-4554-8a24-c78a18338dbe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.809111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32235c7f-7395-4554-8a24-c78a18338dbe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.810502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32235c7f-7395-4554-8a24-c78a18338dbe None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-32235c7f-7395-4554-8a24-c78a18338dbe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:58.820099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:58.821308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 18:12:58.822350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:12:58.826080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 424/839] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:12:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:58.826946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32235c7f-7395-4554-8a24-c78a18338dbe None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:58.886648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db657366-65ab-4269-ba4d-f806a455a6a5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.894627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:58.923946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fded31e-2415-4c99-9916-cd39b6ff1b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.924712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fded31e-2415-4c99-9916-cd39b6ff1b49 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.924960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fded31e-2415-4c99-9916-cd39b6ff1b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.925252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fded31e-2415-4c99-9916-cd39b6ff1b49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.932571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fded31e-2415-4c99-9916-cd39b6ff1b49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.934156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fded31e-2415-4c99-9916-cd39b6ff1b49 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.939921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32235c7f-7395-4554-8a24-c78a18338dbe None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-8fded31e-2415-4c99-9916-cd39b6ff1b49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:12:58.946016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:58.946893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:58.947773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:12:58.947773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:12:58.947773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:12:58.947773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:12:58.947773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:12:58.947773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:12:58.947773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:12:58.947773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:58.947773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 416/840] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:58.948264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fded31e-2415-4c99-9916-cd39b6ff1b49 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:58.980203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84589c5-6056-4726-a48d-91de13eb52df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:58.980821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84589c5-6056-4726-a48d-91de13eb52df None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:58.981098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84589c5-6056-4726-a48d-91de13eb52df None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:58.981404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84589c5-6056-4726-a48d-91de13eb52df None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:58.982123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84589c5-6056-4726-a48d-91de13eb52df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:58.982431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84589c5-6056-4726-a48d-91de13eb52df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:58.984453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84589c5-6056-4726-a48d-91de13eb52df None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:58.991375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:59.007028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 425/841] 10.222.0.61 () {56 vars in 1135 bytes} [Thu Sep 22 18:12:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:59.007028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84589c5-6056-4726-a48d-91de13eb52df None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:59.059965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fded31e-2415-4c99-9916-cd39b6ff1b49 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:59.096585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6356bfc-c870-498d-98ae-e4cd3d5c3489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:59.097205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6356bfc-c870-498d-98ae-e4cd3d5c3489 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:59.097568 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6356bfc-c870-498d-98ae-e4cd3d5c3489 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:59.097844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6356bfc-c870-498d-98ae-e4cd3d5c3489 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:59.098510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6356bfc-c870-498d-98ae-e4cd3d5c3489 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:59.098818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6356bfc-c870-498d-98ae-e4cd3d5c3489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:59.100425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6356bfc-c870-498d-98ae-e4cd3d5c3489 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:59.109769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 417/842] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:12:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:59.109962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84589c5-6056-4726-a48d-91de13eb52df None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:59.110063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6356bfc-c870-498d-98ae-e4cd3d5c3489 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:59.129939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:59.152934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cb4e2-7715-4681-8a04-8cbb54a306aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:59.153507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cb4e2-7715-4681-8a04-8cbb54a306aa None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:59.153802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cb4e2-7715-4681-8a04-8cbb54a306aa None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:59.154058 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cb4e2-7715-4681-8a04-8cbb54a306aa None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:59.154766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cb4e2-7715-4681-8a04-8cbb54a306aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:59.155070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cb4e2-7715-4681-8a04-8cbb54a306aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:59.157102 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cb4e2-7715-4681-8a04-8cbb54a306aa None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:59.171300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 426/843] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:59.174159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cb4e2-7715-4681-8a04-8cbb54a306aa None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:59.224495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6356bfc-c870-498d-98ae-e4cd3d5c3489 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:59.226113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:59.264174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c7e5d-f634-4291-88ea-ff2dbeb297cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:59.264884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7e5d-f634-4291-88ea-ff2dbeb297cd None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:59.265775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7e5d-f634-4291-88ea-ff2dbeb297cd None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:59.266115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c7e5d-f634-4291-88ea-ff2dbeb297cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:59.285912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cb4e2-7715-4681-8a04-8cbb54a306aa None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:59.318940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9c183-673c-42e1-9a15-83a813341b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:59.319552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9c183-673c-42e1-9a15-83a813341b2e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:59.319830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9c183-673c-42e1-9a15-83a813341b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:59.320104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9c183-673c-42e1-9a15-83a813341b2e None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:59.320736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9c183-673c-42e1-9a15-83a813341b2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:59.321037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9c183-673c-42e1-9a15-83a813341b2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:59.322437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9c183-673c-42e1-9a15-83a813341b2e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:59.328045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 427/844] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:12:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:59.329007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9c183-673c-42e1-9a15-83a813341b2e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:59.334290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c7e5d-f634-4291-88ea-ff2dbeb297cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:59.335769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c7e5d-f634-4291-88ea-ff2dbeb297cd None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:59.383863 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:59.458566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9c183-673c-42e1-9a15-83a813341b2e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:59.459458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 418/845] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:12:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:12:59.462905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc50d56-1f4e-4f51-b397-13acc84216cc None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:59.463191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc50d56-1f4e-4f51-b397-13acc84216cc None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:59.463461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc50d56-1f4e-4f51-b397-13acc84216cc None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:59.471097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 419/846] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:12:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:12:59.471097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc50d56-1f4e-4f51-b397-13acc84216cc None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:59.473824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:59.507083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5dab2-00f1-4360-b110-582eb59b1cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:59.507800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5dab2-00f1-4360-b110-582eb59b1cbe None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:59.508085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5dab2-00f1-4360-b110-582eb59b1cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:59.509172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5dab2-00f1-4360-b110-582eb59b1cbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:59.509172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5dab2-00f1-4360-b110-582eb59b1cbe None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=d710bb85a200419aa071e119976115c6) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:59.510227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5dab2-00f1-4360-b110-582eb59b1cbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:59.512192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5dab2-00f1-4360-b110-582eb59b1cbe None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:59.518568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 428/847] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:12:59 2022] GET /identity/v3/role_assignments?user.id=d710bb85a200419aa071e119976115c6&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:59.521118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd586-eaaa-49b0-8c03-d3cc274ba5d5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:59.521118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd586-eaaa-49b0-8c03-d3cc274ba5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:59.521118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd586-eaaa-49b0-8c03-d3cc274ba5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:59.541018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-2b6cd586-eaaa-49b0-8c03-d3cc274ba5d5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:12:59.542084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2b6cd586-eaaa-49b0-8c03-d3cc274ba5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:12:59.623851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc50d56-1f4e-4f51-b397-13acc84216cc None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:59.637401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 429/848] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:12:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:12:59.674163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063585ff-3b55-4d81-a949-d2dfbf958a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:59.674939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063585ff-3b55-4d81-a949-d2dfbf958a2a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:59.675222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063585ff-3b55-4d81-a949-d2dfbf958a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:59.675543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063585ff-3b55-4d81-a949-d2dfbf958a2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:59.688115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063585ff-3b55-4d81-a949-d2dfbf958a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:59.689688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063585ff-3b55-4d81-a949-d2dfbf958a2a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-063585ff-3b55-4d81-a949-d2dfbf958a2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:12:59.706684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:12:59.707687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:12:59.708943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:12:59.708943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:12:59.708943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:12:59.708943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 420/849] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:12:59.713785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd586-eaaa-49b0-8c03-d3cc274ba5d5 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:59.756590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:59.824323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd586-eaaa-49b0-8c03-d3cc274ba5d5 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:12:59.860209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca809a-698d-4380-8c06-35e9839f510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:12:59.860871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca809a-698d-4380-8c06-35e9839f510d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:12:59.861154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca809a-698d-4380-8c06-35e9839f510d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:12:59.861457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca809a-698d-4380-8c06-35e9839f510d None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:12:59.862096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca809a-698d-4380-8c06-35e9839f510d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:12:59.862400 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca809a-698d-4380-8c06-35e9839f510d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:12:59.863867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca809a-698d-4380-8c06-35e9839f510d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:12:59.875788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 430/850] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:12:59.880993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063585ff-3b55-4d81-a949-d2dfbf958a2a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:59.940523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:12:59.949841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca809a-698d-4380-8c06-35e9839f510d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:12:59.996388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063585ff-3b55-4d81-a949-d2dfbf958a2a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:00.031714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcbcaf-8208-4a01-bd46-62f41398419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:00.032411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbcaf-8208-4a01-bd46-62f41398419a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:00.032699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbcaf-8208-4a01-bd46-62f41398419a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:00.032971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbcaf-8208-4a01-bd46-62f41398419a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:00.040077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcbcaf-8208-4a01-bd46-62f41398419a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:00.041614 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcbcaf-8208-4a01-bd46-62f41398419a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-d2dcbcaf-8208-4a01-bd46-62f41398419a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:13:00.054518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:00.055560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:00.056440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:13:00.056440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:13:00.056440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:13:00.056440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:13:00.056440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:13:00.056440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:13:00.056440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:00.056440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:00.060878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 421/851] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:00.061631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcbcaf-8208-4a01-bd46-62f41398419a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:00.061947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:00.070370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca809a-698d-4380-8c06-35e9839f510d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:00.111092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3cf7-2f28-465f-9833-affd92b552b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:00.112152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3cf7-2f28-465f-9833-affd92b552b6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:00.112430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3cf7-2f28-465f-9833-affd92b552b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:00.112704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3cf7-2f28-465f-9833-affd92b552b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:00.124589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e3cf7-2f28-465f-9833-affd92b552b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-a62e3cf7-2f28-465f-9833-affd92b552b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:00.130888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:00.131974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:13:00.132967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:00.137369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 431/852] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:00.138940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3cf7-2f28-465f-9833-affd92b552b6 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:00.193337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcbcaf-8208-4a01-bd46-62f41398419a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:00.211768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:00.246585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd9e55-1658-49c7-a056-ec4f2fdbfde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:00.247436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd9e55-1658-49c7-a056-ec4f2fdbfde3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:00.247860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd9e55-1658-49c7-a056-ec4f2fdbfde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:00.248285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd9e55-1658-49c7-a056-ec4f2fdbfde3 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:00.249801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd9e55-1658-49c7-a056-ec4f2fdbfde3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:00.250295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd9e55-1658-49c7-a056-ec4f2fdbfde3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:00.251995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd9e55-1658-49c7-a056-ec4f2fdbfde3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:00.264260 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3cf7-2f28-465f-9833-affd92b552b6 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:00.273015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 422/853] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:13:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:00.274234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd9e55-1658-49c7-a056-ec4f2fdbfde3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:00.307247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1991-656c-4199-800c-26becd88d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:00.308217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1991-656c-4199-800c-26becd88d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:00.308829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1991-656c-4199-800c-26becd88d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:00.309134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1991-656c-4199-800c-26becd88d6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:00.309998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f1991-656c-4199-800c-26becd88d6b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:00.310399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f1991-656c-4199-800c-26becd88d6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:00.312006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f1991-656c-4199-800c-26becd88d6b9 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:00.323982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 432/854] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:13:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:00.334540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1991-656c-4199-800c-26becd88d6b9 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:00.356086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:00.386186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd9e55-1658-49c7-a056-ec4f2fdbfde3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:00.424089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc50b-ee96-411f-8598-0b410acadba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:00.424704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc50b-ee96-411f-8598-0b410acadba7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:00.424982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc50b-ee96-411f-8598-0b410acadba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:00.425264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc50b-ee96-411f-8598-0b410acadba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:00.426073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc50b-ee96-411f-8598-0b410acadba7 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=e20585b86c2d45da8ca53fa1db2ccd25) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:00.426376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc50b-ee96-411f-8598-0b410acadba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:00.427854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc50b-ee96-411f-8598-0b410acadba7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:00.441561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 423/855] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:00 2022] GET /identity/v3/role_assignments?user.id=e20585b86c2d45da8ca53fa1db2ccd25&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:00.457301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1991-656c-4199-800c-26becd88d6b9 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:00.495765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d40a56-731c-4988-8a3a-204b5b102f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:00.496413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d40a56-731c-4988-8a3a-204b5b102f47 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:00.496745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d40a56-731c-4988-8a3a-204b5b102f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:00.496960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d40a56-731c-4988-8a3a-204b5b102f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:00.511093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d40a56-731c-4988-8a3a-204b5b102f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:00.512551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d40a56-731c-4988-8a3a-204b5b102f47 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-f4d40a56-731c-4988-8a3a-204b5b102f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:00.528654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:00.529677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:00.531379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:00.531379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:00.531379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:00.531379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 433/856] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:00.538494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc50b-ee96-411f-8598-0b410acadba7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:00.589535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:00.667944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc50b-ee96-411f-8598-0b410acadba7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:00.708640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1711-c5cc-413f-b6c0-45245f8c2465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:00.709355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1711-c5cc-413f-b6c0-45245f8c2465 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:00.709632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1711-c5cc-413f-b6c0-45245f8c2465 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:00.709902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1711-c5cc-413f-b6c0-45245f8c2465 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:00.710541 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d1711-c5cc-413f-b6c0-45245f8c2465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:00.710840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d1711-c5cc-413f-b6c0-45245f8c2465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:00.712313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d1711-c5cc-413f-b6c0-45245f8c2465 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:00.729294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 424/857] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:00.731810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d40a56-731c-4988-8a3a-204b5b102f47 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:00.805374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:00.841973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d40a56-731c-4988-8a3a-204b5b102f47 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:00.879135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a63fb3-8fb5-436b-9a2d-dfdb4fb7040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:00.879842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63fb3-8fb5-436b-9a2d-dfdb4fb7040c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:00.880123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63fb3-8fb5-436b-9a2d-dfdb4fb7040c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:00.880452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63fb3-8fb5-436b-9a2d-dfdb4fb7040c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:00.888762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a63fb3-8fb5-436b-9a2d-dfdb4fb7040c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:00.890866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a63fb3-8fb5-436b-9a2d-dfdb4fb7040c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-52a63fb3-8fb5-436b-9a2d-dfdb4fb7040c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:13:00.903373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:00.904340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:13:00.905309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:00.909305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 434/858] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:13:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:00.910745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1711-c5cc-413f-b6c0-45245f8c2465 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:01.020416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:01.031132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1711-c5cc-413f-b6c0-45245f8c2465 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:01.067956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273234-61ce-4069-aa0e-0fb37c12e404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:01.068911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273234-61ce-4069-aa0e-0fb37c12e404 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:01.069465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273234-61ce-4069-aa0e-0fb37c12e404 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:01.069943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273234-61ce-4069-aa0e-0fb37c12e404 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:01.070899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51273234-61ce-4069-aa0e-0fb37c12e404 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:01.071428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51273234-61ce-4069-aa0e-0fb37c12e404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:01.073103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51273234-61ce-4069-aa0e-0fb37c12e404 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:01.097310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 425/859] 10.222.0.61 () {56 vars in 1149 bytes} [Thu Sep 22 18:13:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:01.098949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a63fb3-8fb5-436b-9a2d-dfdb4fb7040c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:01.200979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a63fb3-8fb5-436b-9a2d-dfdb4fb7040c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:01.234044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:01.243854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7a26e-352a-4d5c-aeec-296e78f0586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:01.244857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a26e-352a-4d5c-aeec-296e78f0586d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:01.245444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a26e-352a-4d5c-aeec-296e78f0586d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:01.246052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a26e-352a-4d5c-aeec-296e78f0586d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:01.319385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7a26e-352a-4d5c-aeec-296e78f0586d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:01.321188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7a26e-352a-4d5c-aeec-296e78f0586d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:01.429153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 435/860] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:13:01.431137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273234-61ce-4069-aa0e-0fb37c12e404 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:01.555134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273234-61ce-4069-aa0e-0fb37c12e404 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:01.593080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e160ffc-dc4d-4af3-a26b-67a9f65c7ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:01.593680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e160ffc-dc4d-4af3-a26b-67a9f65c7ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:01.593956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e160ffc-dc4d-4af3-a26b-67a9f65c7ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:01.594250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e160ffc-dc4d-4af3-a26b-67a9f65c7ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:01.596949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9633164-b646-4d5d-b22c-7a6585fb9280 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:01.597280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9633164-b646-4d5d-b22c-7a6585fb9280 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:01.597546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9633164-b646-4d5d-b22c-7a6585fb9280 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:01.599130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 436/861] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:01.604555 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f262fa-b4d3-4a86-85bd-6a79dc09ffbc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:01.604836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f262fa-b4d3-4a86-85bd-6a79dc09ffbc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:01.605118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f262fa-b4d3-4a86-85bd-6a79dc09ffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:01.609613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e160ffc-dc4d-4af3-a26b-67a9f65c7ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:01.611080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e160ffc-dc4d-4af3-a26b-67a9f65c7ec5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:01.624979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-59f262fa-b4d3-4a86-85bd-6a79dc09ffbc None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:01.626230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-59f262fa-b4d3-4a86-85bd-6a79dc09ffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-9e160ffc-dc4d-4af3-a26b-67a9f65c7ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:01.627591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:01.628480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:01.629618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:01.629618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:01.629618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:01.629618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 426/862] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:01.639081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e160ffc-dc4d-4af3-a26b-67a9f65c7ec5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:01.650732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:01.657595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:01.721592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 437/863] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:01.752710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e160ffc-dc4d-4af3-a26b-67a9f65c7ec5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:01.791509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be371ae9-2c69-4833-8643-671f4f563e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:01.792151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be371ae9-2c69-4833-8643-671f4f563e88 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:01.792434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be371ae9-2c69-4833-8643-671f4f563e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:01.792732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be371ae9-2c69-4833-8643-671f4f563e88 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:01.793465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be371ae9-2c69-4833-8643-671f4f563e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:01.793775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be371ae9-2c69-4833-8643-671f4f563e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:01.795244 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be371ae9-2c69-4833-8643-671f4f563e88 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:01.809804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 427/864] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:01.815198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f262fa-b4d3-4a86-85bd-6a79dc09ffbc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:01.896040 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b151-c89f-43c5-9323-96e0695bf0e0 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:01.896295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b151-c89f-43c5-9323-96e0695bf0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:01.896708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b151-c89f-43c5-9323-96e0695bf0e0 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:01.898162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 428/865] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:01.903514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c811878-601b-4ada-81aa-9e3bba74d1a9 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:01.903800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c811878-601b-4ada-81aa-9e3bba74d1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:01.904082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c811878-601b-4ada-81aa-9e3bba74d1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:01.922552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f262fa-b4d3-4a86-85bd-6a79dc09ffbc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:01.923050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4c811878-601b-4ada-81aa-9e3bba74d1a9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:01.923927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4c811878-601b-4ada-81aa-9e3bba74d1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:01.962476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7b38-017e-4b9f-83a5-c5e4c4ec8952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:01.963375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7b38-017e-4b9f-83a5-c5e4c4ec8952 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:01.963656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7b38-017e-4b9f-83a5-c5e4c4ec8952 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:01.963929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7b38-017e-4b9f-83a5-c5e4c4ec8952 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:01.972326 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c7b38-017e-4b9f-83a5-c5e4c4ec8952 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:01.974357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c7b38-017e-4b9f-83a5-c5e4c4ec8952 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-3f8c7b38-017e-4b9f-83a5-c5e4c4ec8952 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:13:01.989507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:01.990419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:01.991300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:13:01.991300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:13:01.991300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:13:01.991300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:13:01.991300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:13:01.991300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:13:01.991300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:01.991300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:01.993377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 438/866] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:01.996797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7b38-017e-4b9f-83a5-c5e4c4ec8952 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:02.003279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:02.014804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 429/867] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:02.016346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c811878-601b-4ada-81aa-9e3bba74d1a9 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:02.029585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:02.137699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7b38-017e-4b9f-83a5-c5e4c4ec8952 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:02.139518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c811878-601b-4ada-81aa-9e3bba74d1a9 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:02.173994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341ffb-6191-4b4f-a8cb-8cb98d52cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:02.174727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341ffb-6191-4b4f-a8cb-8cb98d52cd28 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:02.175085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341ffb-6191-4b4f-a8cb-8cb98d52cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:02.175435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341ffb-6191-4b4f-a8cb-8cb98d52cd28 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:02.176202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341ffb-6191-4b4f-a8cb-8cb98d52cd28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:02.176581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341ffb-6191-4b4f-a8cb-8cb98d52cd28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:02.178119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341ffb-6191-4b4f-a8cb-8cb98d52cd28 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:02.184453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781787-eb48-4981-bd9a-7a94ee58bc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:02.185070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781787-eb48-4981-bd9a-7a94ee58bc91 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:02.185373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781787-eb48-4981-bd9a-7a94ee58bc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:02.185643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781787-eb48-4981-bd9a-7a94ee58bc91 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:02.186357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5781787-eb48-4981-bd9a-7a94ee58bc91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:02.188930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5781787-eb48-4981-bd9a-7a94ee58bc91 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:02.194128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 439/868] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:02.200334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341ffb-6191-4b4f-a8cb-8cb98d52cd28 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:02.213370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 430/869] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:13:02 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:02.303487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781787-eb48-4981-bd9a-7a94ee58bc91 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:02.304432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:02.332595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341ffb-6191-4b4f-a8cb-8cb98d52cd28 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:02.369567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:02.385595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b89ae-59e1-414f-9bcf-58945e1667db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:02.386620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b89ae-59e1-414f-9bcf-58945e1667db None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:02.387063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b89ae-59e1-414f-9bcf-58945e1667db None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:02.387602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b89ae-59e1-414f-9bcf-58945e1667db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:02.388522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b89ae-59e1-414f-9bcf-58945e1667db None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=99c9b7ef3a7345879747a2193ad8044c) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:02.389091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b89ae-59e1-414f-9bcf-58945e1667db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:02.391279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b89ae-59e1-414f-9bcf-58945e1667db None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:02.398877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 440/870] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:02 2022] GET /identity/v3/role_assignments?user.id=99c9b7ef3a7345879747a2193ad8044c&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:02.422287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781787-eb48-4981-bd9a-7a94ee58bc91 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:02.465981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e32118-6b8a-448f-a070-1faa54446e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:02.466924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e32118-6b8a-448f-a070-1faa54446e9f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:02.467371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e32118-6b8a-448f-a070-1faa54446e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:02.467813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e32118-6b8a-448f-a070-1faa54446e9f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:02.468500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e32118-6b8a-448f-a070-1faa54446e9f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:02.470063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e32118-6b8a-448f-a070-1faa54446e9f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-51e32118-6b8a-448f-a070-1faa54446e9f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:02.481108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:02.482108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:02.482994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 431/871] 10.222.0.61 () {56 vars in 1132 bytes} [Thu Sep 22 18:13:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:02.491223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b89ae-59e1-414f-9bcf-58945e1667db None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:02.607899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b89ae-59e1-414f-9bcf-58945e1667db None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:02.643329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c3364-f150-4b7b-aeee-6de05db73aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:02.643956 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c3364-f150-4b7b-aeee-6de05db73aaa None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:02.644237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c3364-f150-4b7b-aeee-6de05db73aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:02.644513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c3364-f150-4b7b-aeee-6de05db73aaa None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:02.645149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c3364-f150-4b7b-aeee-6de05db73aaa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:02.645557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c3364-f150-4b7b-aeee-6de05db73aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:02.647033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c3364-f150-4b7b-aeee-6de05db73aaa None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:02.652106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 441/872] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:02.662308 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e32118-6b8a-448f-a070-1faa54446e9f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:02.773756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e32118-6b8a-448f-a070-1faa54446e9f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:02.798952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:02.813279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e5da-72a3-4fb3-96af-8ad75b0be1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:02.813902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e5da-72a3-4fb3-96af-8ad75b0be1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:02.814187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e5da-72a3-4fb3-96af-8ad75b0be1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:02.814457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e5da-72a3-4fb3-96af-8ad75b0be1f1 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:02.815089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e5da-72a3-4fb3-96af-8ad75b0be1f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:02.815389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e5da-72a3-4fb3-96af-8ad75b0be1f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:02.816747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e5da-72a3-4fb3-96af-8ad75b0be1f1 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:02.821768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 432/873] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:02.856810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bae9ef-5104-41cc-9ded-4f926f50ec26 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:02.857143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bae9ef-5104-41cc-9ded-4f926f50ec26 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:02.857449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bae9ef-5104-41cc-9ded-4f926f50ec26 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:02.859291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 442/874] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:02.865224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eada7-a6d2-469e-aa3c-30deacd8df32 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:02.865547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eada7-a6d2-469e-aa3c-30deacd8df32 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:02.865795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eada7-a6d2-469e-aa3c-30deacd8df32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:02.885465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-595eada7-a6d2-469e-aa3c-30deacd8df32 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:02.886692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-595eada7-a6d2-469e-aa3c-30deacd8df32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:02.975473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 433/875] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:03.250473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bae9ef-5104-41cc-9ded-4f926f50ec26 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:03.253649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:03.359754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bae9ef-5104-41cc-9ded-4f926f50ec26 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:03.394199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2480c0-43d0-4c12-b27b-b5a2a1cbe170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:03.395113 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2480c0-43d0-4c12-b27b-b5a2a1cbe170 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:03.395542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2480c0-43d0-4c12-b27b-b5a2a1cbe170 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:03.396020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2480c0-43d0-4c12-b27b-b5a2a1cbe170 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:03.396745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2480c0-43d0-4c12-b27b-b5a2a1cbe170 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:03.398281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2480c0-43d0-4c12-b27b-b5a2a1cbe170 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-cc2480c0-43d0-4c12-b27b-b5a2a1cbe170 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:03.407860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:03.409039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:03.410105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:03.412395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 443/876] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:03.418379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eada7-a6d2-469e-aa3c-30deacd8df32 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:03.541225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595eada7-a6d2-469e-aa3c-30deacd8df32 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:03.559265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:03.586258 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633565bb-6a30-4ab2-9da6-eb5943a82afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:03.586880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633565bb-6a30-4ab2-9da6-eb5943a82afc None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:03.587171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633565bb-6a30-4ab2-9da6-eb5943a82afc None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:03.587449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633565bb-6a30-4ab2-9da6-eb5943a82afc None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:03.588346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633565bb-6a30-4ab2-9da6-eb5943a82afc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:03.588653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633565bb-6a30-4ab2-9da6-eb5943a82afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:03.590060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633565bb-6a30-4ab2-9da6-eb5943a82afc None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:03.595480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 434/877] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:03.600957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2480c0-43d0-4c12-b27b-b5a2a1cbe170 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:03.680109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:03.716920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2480c0-43d0-4c12-b27b-b5a2a1cbe170 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:03.754104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507f1ec-1f79-4b52-b9a9-8784852d09c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:03.754743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f1ec-1f79-4b52-b9a9-8784852d09c6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:03.755028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f1ec-1f79-4b52-b9a9-8784852d09c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:03.755357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f1ec-1f79-4b52-b9a9-8784852d09c6 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:03.756025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507f1ec-1f79-4b52-b9a9-8784852d09c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:03.756332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507f1ec-1f79-4b52-b9a9-8784852d09c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:03.757775 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507f1ec-1f79-4b52-b9a9-8784852d09c6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:03.763485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 444/878] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:04.556753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eedaca-042f-48d6-b77a-d7389c5ffa96 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:04.557893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eedaca-042f-48d6-b77a-d7389c5ffa96 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:04.558431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eedaca-042f-48d6-b77a-d7389c5ffa96 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:04.560299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 435/879] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:04.566634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9a4e-7c83-4b2e-9cf5-c345ace44442 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:04.567503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9a4e-7c83-4b2e-9cf5-c345ace44442 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:04.568002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9a4e-7c83-4b2e-9cf5-c345ace44442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:04.586629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-09aa9a4e-7c83-4b2e-9cf5-c345ace44442 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:04.588408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-09aa9a4e-7c83-4b2e-9cf5-c345ace44442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:04.659703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 445/880] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:04.798012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c33d84-b9d7-4f5d-aac7-23fc8a5a8be2 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:04.798360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c33d84-b9d7-4f5d-aac7-23fc8a5a8be2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:04.798571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c33d84-b9d7-4f5d-aac7-23fc8a5a8be2 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:04.800042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 436/881] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:04.805449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3e40-92e0-42af-8e5a-df41ea8cc7af None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:04.805974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3e40-92e0-42af-8e5a-df41ea8cc7af None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:04.806449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3e40-92e0-42af-8e5a-df41ea8cc7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:04.826609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-03fa3e40-92e0-42af-8e5a-df41ea8cc7af None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:04.828703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-03fa3e40-92e0-42af-8e5a-df41ea8cc7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:04.888299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:04.905708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 446/882] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:04.947103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c33d84-b9d7-4f5d-aac7-23fc8a5a8be2 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.062746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d187d7-390f-4b18-9b3e-4b482c78fbfc None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.063393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d187d7-390f-4b18-9b3e-4b482c78fbfc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.063888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d187d7-390f-4b18-9b3e-4b482c78fbfc None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.065697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 447/883] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:05.067082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c33d84-b9d7-4f5d-aac7-23fc8a5a8be2 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:05.073267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e290-ca65-4e83-8ac7-9da6b443efc9 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.073267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e290-ca65-4e83-8ac7-9da6b443efc9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.073267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e290-ca65-4e83-8ac7-9da6b443efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.091427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-2017e290-ca65-4e83-8ac7-9da6b443efc9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:05.092940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2017e290-ca65-4e83-8ac7-9da6b443efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:05.118476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f44834-9783-4a31-ba63-0c7e90686dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:05.119692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f44834-9783-4a31-ba63-0c7e90686dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.119981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f44834-9783-4a31-ba63-0c7e90686dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.120261 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f44834-9783-4a31-ba63-0c7e90686dd3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.120852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f44834-9783-4a31-ba63-0c7e90686dd3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:05.122527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f44834-9783-4a31-ba63-0c7e90686dd3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-85f44834-9783-4a31-ba63-0c7e90686dd3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:05.135269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:05.136287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 18:13:05.137152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:05.141458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 437/884] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:13:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:05.143226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f44834-9783-4a31-ba63-0c7e90686dd3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.177678 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 448/885] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:05.193757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017e290-ca65-4e83-8ac7-9da6b443efc9 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.206823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:05.271137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f44834-9783-4a31-ba63-0c7e90686dd3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:05.313802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966cc42-ce49-4382-bf00-48e16856deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:05.314693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966cc42-ce49-4382-bf00-48e16856deed None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.315135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966cc42-ce49-4382-bf00-48e16856deed None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.315679 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966cc42-ce49-4382-bf00-48e16856deed None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.316585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966cc42-ce49-4382-bf00-48e16856deed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:05.316890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966cc42-ce49-4382-bf00-48e16856deed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:05.318449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966cc42-ce49-4382-bf00-48e16856deed None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:05.325107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 438/886] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:13:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:05.333284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017e290-ca65-4e83-8ac7-9da6b443efc9 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:05.334361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966cc42-ce49-4382-bf00-48e16856deed None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.360214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:05.379763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5a30-ce05-49fd-ab1b-035d7ecb9c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:05.380421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5a30-ce05-49fd-ab1b-035d7ecb9c2e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.380705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5a30-ce05-49fd-ab1b-035d7ecb9c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.380985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5a30-ce05-49fd-ab1b-035d7ecb9c2e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.396705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce5a30-ce05-49fd-ab1b-035d7ecb9c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-69ce5a30-ce05-49fd-ab1b-035d7ecb9c2e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:05.401593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:05.402611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:05.403473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 449/887] 10.222.0.61 () {56 vars in 1120 bytes} [Thu Sep 22 18:13:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:05.409066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5a30-ce05-49fd-ab1b-035d7ecb9c2e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.468269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966cc42-ce49-4382-bf00-48e16856deed None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:05.481479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:05.509538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c243d40-3edc-4698-b7d2-066f14feed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:05.510159 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c243d40-3edc-4698-b7d2-066f14feed6d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.510436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c243d40-3edc-4698-b7d2-066f14feed6d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.510707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c243d40-3edc-4698-b7d2-066f14feed6d None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.511343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c243d40-3edc-4698-b7d2-066f14feed6d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:05.511644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c243d40-3edc-4698-b7d2-066f14feed6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:05.513007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c243d40-3edc-4698-b7d2-066f14feed6d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:05.518986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 439/888] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:13:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:05.519780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c243d40-3edc-4698-b7d2-066f14feed6d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.530912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5a30-ce05-49fd-ab1b-035d7ecb9c2e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:05.567617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31555a94-cef1-4105-a17a-d2d91eab31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:05.568290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31555a94-cef1-4105-a17a-d2d91eab31d9 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.568524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31555a94-cef1-4105-a17a-d2d91eab31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.568971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31555a94-cef1-4105-a17a-d2d91eab31d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.570010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31555a94-cef1-4105-a17a-d2d91eab31d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:05.570474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31555a94-cef1-4105-a17a-d2d91eab31d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:05.571844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31555a94-cef1-4105-a17a-d2d91eab31d9 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:05.581039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 450/889] 10.222.0.61 () {56 vars in 1115 bytes} [Thu Sep 22 18:13:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:05.582210 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31555a94-cef1-4105-a17a-d2d91eab31d9 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.636530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:05.641826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c243d40-3edc-4698-b7d2-066f14feed6d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:05.687948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ae65-508a-4fa3-94a0-583304a22818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:05.688825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ae65-508a-4fa3-94a0-583304a22818 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.689339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ae65-508a-4fa3-94a0-583304a22818 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.689738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ae65-508a-4fa3-94a0-583304a22818 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.690422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033ae65-508a-4fa3-94a0-583304a22818 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:05.691811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033ae65-508a-4fa3-94a0-583304a22818 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:05.707029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 440/890] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:13:05 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:05.708042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ae65-508a-4fa3-94a0-583304a22818 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.723629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31555a94-cef1-4105-a17a-d2d91eab31d9 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:05.744243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:05.787482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffbc02-48fe-46da-ab40-b3a3a39b844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:05.788119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffbc02-48fe-46da-ab40-b3a3a39b844d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.788498 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffbc02-48fe-46da-ab40-b3a3a39b844d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.788777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffbc02-48fe-46da-ab40-b3a3a39b844d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.789836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffbc02-48fe-46da-ab40-b3a3a39b844d None admin] RBAC: Adding query filter params (interface=public, service_id=a9243280880448f5a79590b6c55ba6ea, region_id=RegionOne) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:05.789836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffbc02-48fe-46da-ab40-b3a3a39b844d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:05.791329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffbc02-48fe-46da-ab40-b3a3a39b844d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:05.799699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 451/891] 10.222.0.61 () {56 vars in 1251 bytes} [Thu Sep 22 18:13:05 2022] GET /identity/v3/endpoints?service_id=a9243280880448f5a79590b6c55ba6ea&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:05.805057 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffbc02-48fe-46da-ab40-b3a3a39b844d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.852913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ae65-508a-4fa3-94a0-583304a22818 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:05.899908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558d2d7-df65-4198-9ff8-7f71dc303463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:05.900969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558d2d7-df65-4198-9ff8-7f71dc303463 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.901557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558d2d7-df65-4198-9ff8-7f71dc303463 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.902039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558d2d7-df65-4198-9ff8-7f71dc303463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.915133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558d2d7-df65-4198-9ff8-7f71dc303463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:05.916740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558d2d7-df65-4198-9ff8-7f71dc303463 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-e558d2d7-df65-4198-9ff8-7f71dc303463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:05.933224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:05.934254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:05.935124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:05.935124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:05.935124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:05.935124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 441/892] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:05.940070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558d2d7-df65-4198-9ff8-7f71dc303463 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:05.945723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffbc02-48fe-46da-ab40-b3a3a39b844d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:05.947419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:05.995541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc571a0-d841-4e8b-a588-e1890eb85fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:05.996162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc571a0-d841-4e8b-a588-e1890eb85fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:05.996440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc571a0-d841-4e8b-a588-e1890eb85fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:05.996717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc571a0-d841-4e8b-a588-e1890eb85fc3 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:05.997351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc571a0-d841-4e8b-a588-e1890eb85fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:05.999211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc571a0-d841-4e8b-a588-e1890eb85fc3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:06.007982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 452/893] 10.222.0.61 () {56 vars in 1087 bytes} [Thu Sep 22 18:13:05 2022] GET /identity/v3/services => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:13:06.034738 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8fa9-5c98-4e9f-a950-79edec98bc19 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:06.036047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8fa9-5c98-4e9f-a950-79edec98bc19 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:06.036327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8fa9-5c98-4e9f-a950-79edec98bc19 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:06.038119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 453/894] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:06.047052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c415c0d-3230-4140-971b-31e81c687aa1 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:06.047384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c415c0d-3230-4140-971b-31e81c687aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:06.047598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c415c0d-3230-4140-971b-31e81c687aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:06.059014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:06.073305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1c415c0d-3230-4140-971b-31e81c687aa1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:06.074943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1c415c0d-3230-4140-971b-31e81c687aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:06.080203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558d2d7-df65-4198-9ff8-7f71dc303463 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:06.119692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972095-f16d-4060-b24a-fb60c325522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:06.120325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972095-f16d-4060-b24a-fb60c325522a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:06.120611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972095-f16d-4060-b24a-fb60c325522a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:06.120888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972095-f16d-4060-b24a-fb60c325522a None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:06.121597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972095-f16d-4060-b24a-fb60c325522a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:06.121906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972095-f16d-4060-b24a-fb60c325522a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:06.123391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972095-f16d-4060-b24a-fb60c325522a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:06.142100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 442/895] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:06.144531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972095-f16d-4060-b24a-fb60c325522a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:06.184019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 454/896] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:06.263155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972095-f16d-4060-b24a-fb60c325522a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:06.300049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83ff7c-40c5-43fd-9810-b7dbe4b812be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:06.301034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83ff7c-40c5-43fd-9810-b7dbe4b812be None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:06.301539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83ff7c-40c5-43fd-9810-b7dbe4b812be None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:06.302056 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83ff7c-40c5-43fd-9810-b7dbe4b812be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:06.309641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83ff7c-40c5-43fd-9810-b7dbe4b812be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:06.311334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83ff7c-40c5-43fd-9810-b7dbe4b812be None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-aa83ff7c-40c5-43fd-9810-b7dbe4b812be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:13:06.323544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:06.324494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:13:06.325448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:06.327963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 443/897] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:13:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:06.333914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c415c0d-3230-4140-971b-31e81c687aa1 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:06.434790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:06.440897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c415c0d-3230-4140-971b-31e81c687aa1 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:06.449816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83ff7c-40c5-43fd-9810-b7dbe4b812be None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:06.453790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:06.486322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c9f5c-ba02-4550-8759-78f28be743c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:06.487065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c9f5c-ba02-4550-8759-78f28be743c7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:06.487349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c9f5c-ba02-4550-8759-78f28be743c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:06.487691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c9f5c-ba02-4550-8759-78f28be743c7 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:06.488567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c9f5c-ba02-4550-8759-78f28be743c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:06.489006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c9f5c-ba02-4550-8759-78f28be743c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:06.490760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c9f5c-ba02-4550-8759-78f28be743c7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:06.514330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 455/898] 10.222.0.61 () {56 vars in 1149 bytes} [Thu Sep 22 18:13:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:06.516891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c9f5c-ba02-4550-8759-78f28be743c7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:06.585225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83ff7c-40c5-43fd-9810-b7dbe4b812be None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:06.624217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef7047-9dca-4ee2-a276-b9ba1af3996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:06.625043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef7047-9dca-4ee2-a276-b9ba1af3996b None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:06.625669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef7047-9dca-4ee2-a276-b9ba1af3996b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:06.625960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef7047-9dca-4ee2-a276-b9ba1af3996b None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:06.626903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef7047-9dca-4ee2-a276-b9ba1af3996b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:06.628268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c9f5c-ba02-4550-8759-78f28be743c7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:06.628693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef7047-9dca-4ee2-a276-b9ba1af3996b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:06.657356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 444/899] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:13:06 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:13:06.691703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b6b7-706e-40c5-a62f-686a830f1d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:06.692722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b6b7-706e-40c5-a62f-686a830f1d11 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:06.693394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b6b7-706e-40c5-a62f-686a830f1d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:06.693941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b6b7-706e-40c5-a62f-686a830f1d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:06.717667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:06.775429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541b6b7-706e-40c5-a62f-686a830f1d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:06.777311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541b6b7-706e-40c5-a62f-686a830f1d11 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:06.897825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 456/900] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:06 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:13:06.903412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef7047-9dca-4ee2-a276-b9ba1af3996b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:06.970638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:07.030680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef7047-9dca-4ee2-a276-b9ba1af3996b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:07.067245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9b7ad-cf5f-4bcf-b666-d130af3e7065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:07.068172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9b7ad-cf5f-4bcf-b666-d130af3e7065 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:07.068607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9b7ad-cf5f-4bcf-b666-d130af3e7065 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:07.069082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9b7ad-cf5f-4bcf-b666-d130af3e7065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:07.081375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9b7ad-cf5f-4bcf-b666-d130af3e7065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:07.083096 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9b7ad-cf5f-4bcf-b666-d130af3e7065 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-1eb9b7ad-cf5f-4bcf-b666-d130af3e7065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:07.099183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:07.100371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:07.101536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:07.101536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:07.101536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:07.103233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 445/901] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:07.109301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b6b7-706e-40c5-a62f-686a830f1d11 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:07.166240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:07.222033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b6b7-706e-40c5-a62f-686a830f1d11 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:07.260988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7ee51-17a7-412a-91bb-41a0f2aeca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:07.261882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ee51-17a7-412a-91bb-41a0f2aeca91 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:07.262315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ee51-17a7-412a-91bb-41a0f2aeca91 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:07.262735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ee51-17a7-412a-91bb-41a0f2aeca91 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:07.263618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7ee51-17a7-412a-91bb-41a0f2aeca91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:07.264082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7ee51-17a7-412a-91bb-41a0f2aeca91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:07.265676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7ee51-17a7-412a-91bb-41a0f2aeca91 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:07.279210 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 457/902] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:07.286295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9b7ad-cf5f-4bcf-b666-d130af3e7065 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:07.402339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9b7ad-cf5f-4bcf-b666-d130af3e7065 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:07.420344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:07.439870 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140b436-f7b1-4871-af6e-f05a436eaa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:07.440742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140b436-f7b1-4871-af6e-f05a436eaa85 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:07.441174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140b436-f7b1-4871-af6e-f05a436eaa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:07.441644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140b436-f7b1-4871-af6e-f05a436eaa85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:07.448851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140b436-f7b1-4871-af6e-f05a436eaa85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:07.450484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140b436-f7b1-4871-af6e-f05a436eaa85 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-6140b436-f7b1-4871-af6e-f05a436eaa85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:13:07.463698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:07.464802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:07.465915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:13:07.465915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:13:07.465915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:13:07.465915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:13:07.465915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:13:07.465915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:13:07.465915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:07.465915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:07.467912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 446/903] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:07.474030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7ee51-17a7-412a-91bb-41a0f2aeca91 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:07.584258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7ee51-17a7-412a-91bb-41a0f2aeca91 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:07.595980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:07.621124 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3668091-c4de-4061-af07-248605fcc9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:07.622059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3668091-c4de-4061-af07-248605fcc9de None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:07.622618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3668091-c4de-4061-af07-248605fcc9de None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:07.623040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3668091-c4de-4061-af07-248605fcc9de None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:07.623905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3668091-c4de-4061-af07-248605fcc9de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:07.624458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3668091-c4de-4061-af07-248605fcc9de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:07.626554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3668091-c4de-4061-af07-248605fcc9de None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:07.639432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 458/904] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:07.646096 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140b436-f7b1-4871-af6e-f05a436eaa85 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:07.769777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140b436-f7b1-4871-af6e-f05a436eaa85 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:07.809624 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9c3c-83d6-463a-a097-ba05dfaa84e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:07.810238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9c3c-83d6-463a-a097-ba05dfaa84e2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:07.810522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9c3c-83d6-463a-a097-ba05dfaa84e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:07.810799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9c3c-83d6-463a-a097-ba05dfaa84e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:07.811533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9c3c-83d6-463a-a097-ba05dfaa84e2 None admin] RBAC: Adding query filter params (role.id=9d1b8b0e878a4d08ab0b856406a139ad, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=99c9b7ef3a7345879747a2193ad8044c) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:07.812362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9c3c-83d6-463a-a097-ba05dfaa84e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:07.813830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9c3c-83d6-463a-a097-ba05dfaa84e2 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:07.819895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 447/905] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:07 2022] GET /identity/v3/role_assignments?user.id=99c9b7ef3a7345879747a2193ad8044c&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=9d1b8b0e878a4d08ab0b856406a139ad => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:08.057128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aaf69-8969-47d1-aef8-c0c9b671f7bd None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:08.057455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aaf69-8969-47d1-aef8-c0c9b671f7bd None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:08.057627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aaf69-8969-47d1-aef8-c0c9b671f7bd None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:08.059245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 459/906] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:08.065183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cbfb7-b100-4586-932f-5451527c2f7b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:08.065500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cbfb7-b100-4586-932f-5451527c2f7b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:08.065781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cbfb7-b100-4586-932f-5451527c2f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:08.085179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-190cbfb7-b100-4586-932f-5451527c2f7b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:08.086739 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-190cbfb7-b100-4586-932f-5451527c2f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:08.128820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:08.163229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 448/907] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:08.292181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593b491-65dc-4c99-99f9-f1c5bd45c6dd None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:08.292543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593b491-65dc-4c99-99f9-f1c5bd45c6dd None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:08.292736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593b491-65dc-4c99-99f9-f1c5bd45c6dd None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:08.294359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 460/908] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:08.300207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1d43-384d-4611-9792-22704c4968a2 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:08.300495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1d43-384d-4611-9792-22704c4968a2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:08.300772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a1d43-384d-4611-9792-22704c4968a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:08.319643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-cb2a1d43-384d-4611-9792-22704c4968a2 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:08.320767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-cb2a1d43-384d-4611-9792-22704c4968a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:08.394903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 449/909] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:08.451858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593b491-65dc-4c99-99f9-f1c5bd45c6dd None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:08.563327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593b491-65dc-4c99-99f9-f1c5bd45c6dd None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:08.600720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78121e-d29d-489f-affd-cb8f1b759b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:08.601729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78121e-d29d-489f-affd-cb8f1b759b36 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:08.602209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78121e-d29d-489f-affd-cb8f1b759b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:08.602700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78121e-d29d-489f-affd-cb8f1b759b36 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:08.603494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78121e-d29d-489f-affd-cb8f1b759b36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:08.605126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78121e-d29d-489f-affd-cb8f1b759b36 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-da78121e-d29d-489f-affd-cb8f1b759b36 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:08.615396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:08.616482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 18:13:08.617421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:08.620250 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 461/910] 10.222.0.61 () {56 vars in 1132 bytes} [Thu Sep 22 18:13:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:08.626531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a1d43-384d-4611-9792-22704c4968a2 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:08.668142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78121e-d29d-489f-affd-cb8f1b759b36 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:08.710379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:08.748705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:08.753140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a1d43-384d-4611-9792-22704c4968a2 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:08.795923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c0c26-dc42-401c-b010-a39e32a72112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:08.797566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c0c26-dc42-401c-b010-a39e32a72112 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:08.798090 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c0c26-dc42-401c-b010-a39e32a72112 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:08.798582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c0c26-dc42-401c-b010-a39e32a72112 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:08.799448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c0c26-dc42-401c-b010-a39e32a72112 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:08.800063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c0c26-dc42-401c-b010-a39e32a72112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:08.801327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78121e-d29d-489f-affd-cb8f1b759b36 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:08.801981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c0c26-dc42-401c-b010-a39e32a72112 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:08.807908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 450/911] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:08.814941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c0c26-dc42-401c-b010-a39e32a72112 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:08.844939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd052d9c-d91e-43a9-a750-f298de6fa65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:08.845770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052d9c-d91e-43a9-a750-f298de6fa65c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:08.846060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052d9c-d91e-43a9-a750-f298de6fa65c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:08.846335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052d9c-d91e-43a9-a750-f298de6fa65c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:08.846930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd052d9c-d91e-43a9-a750-f298de6fa65c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:08.848913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd052d9c-d91e-43a9-a750-f298de6fa65c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-bd052d9c-d91e-43a9-a750-f298de6fa65c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:08.859923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:08.860924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 18:13:08.861802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:08.865317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 462/912] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:13:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:08.866913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd052d9c-d91e-43a9-a750-f298de6fa65c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:08.934555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c0c26-dc42-401c-b010-a39e32a72112 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:08.970722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b8272-6044-47fb-aff2-0f71295fa6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:08.971343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b8272-6044-47fb-aff2-0f71295fa6ad None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:08.971625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b8272-6044-47fb-aff2-0f71295fa6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:08.971902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b8272-6044-47fb-aff2-0f71295fa6ad None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:08.972835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b8272-6044-47fb-aff2-0f71295fa6ad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:08.972835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b8272-6044-47fb-aff2-0f71295fa6ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:08.974271 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b8272-6044-47fb-aff2-0f71295fa6ad None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:08.984902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 451/913] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:08.985826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b8272-6044-47fb-aff2-0f71295fa6ad None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:09.006793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:09.012296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd052d9c-d91e-43a9-a750-f298de6fa65c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:09.017204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:09.052807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb06aa-fcaa-46ea-b368-cf243e4867e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:09.053452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb06aa-fcaa-46ea-b368-cf243e4867e4 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:09.053735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb06aa-fcaa-46ea-b368-cf243e4867e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:09.054014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb06aa-fcaa-46ea-b368-cf243e4867e4 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:09.054812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb06aa-fcaa-46ea-b368-cf243e4867e4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:09.055434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb06aa-fcaa-46ea-b368-cf243e4867e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:09.056797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb06aa-fcaa-46ea-b368-cf243e4867e4 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:09.061801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 463/914] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:13:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:09.068014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc977dd-cdef-475f-9330-e97c62454ad0 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:09.068303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc977dd-cdef-475f-9330-e97c62454ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:09.068932 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc977dd-cdef-475f-9330-e97c62454ad0 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:09.070009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 464/915] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:09.070565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc977dd-cdef-475f-9330-e97c62454ad0 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:09.098694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b8272-6044-47fb-aff2-0f71295fa6ad None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:09.137294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c1c1-9c06-4a24-b026-09239ca403c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:09.137813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c1c1-9c06-4a24-b026-09239ca403c1 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:09.138100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c1c1-9c06-4a24-b026-09239ca403c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:09.138374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c1c1-9c06-4a24-b026-09239ca403c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:09.139079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c1c1-9c06-4a24-b026-09239ca403c1 None admin] RBAC: Adding query filter params (interface=public, service_id=72530218ae594f96a7290ff52b0d5755, region_id=RegionOne) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:09.139387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c1c1-9c06-4a24-b026-09239ca403c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:09.141294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c1c1-9c06-4a24-b026-09239ca403c1 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:09.150906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 452/916] 10.222.0.61 () {56 vars in 1251 bytes} [Thu Sep 22 18:13:08 2022] GET /identity/v3/endpoints?service_id=72530218ae594f96a7290ff52b0d5755&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:09.150906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f921a-d80c-4042-8029-017596cb8986 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:09.150906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f921a-d80c-4042-8029-017596cb8986 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:09.150906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f921a-d80c-4042-8029-017596cb8986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:09.166938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a57f921a-d80c-4042-8029-017596cb8986 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:09.168149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a57f921a-d80c-4042-8029-017596cb8986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:09.189739 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc977dd-cdef-475f-9330-e97c62454ad0 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:09.229611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b31f-6ca6-4551-b8c8-f99a2ec5cda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:09.230234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b31f-6ca6-4551-b8c8-f99a2ec5cda1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:09.230520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b31f-6ca6-4551-b8c8-f99a2ec5cda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:09.230797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b31f-6ca6-4551-b8c8-f99a2ec5cda1 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:09.231434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6b31f-6ca6-4551-b8c8-f99a2ec5cda1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:09.231744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6b31f-6ca6-4551-b8c8-f99a2ec5cda1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:09.233110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6b31f-6ca6-4551-b8c8-f99a2ec5cda1 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:09.238345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 465/917] 10.222.0.61 () {56 vars in 1114 bytes} [Thu Sep 22 18:13:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:09.240969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 453/918] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:09.243673 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b31f-6ca6-4551-b8c8-f99a2ec5cda1 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:09.254140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f921a-d80c-4042-8029-017596cb8986 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:09.276742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:09.282168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:09.366175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b31f-6ca6-4551-b8c8-f99a2ec5cda1 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:09.366449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f921a-d80c-4042-8029-017596cb8986 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:09.403729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ea304-492c-46e3-8100-df0c1bb163b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:09.404729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ea304-492c-46e3-8100-df0c1bb163b2 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:09.405157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ea304-492c-46e3-8100-df0c1bb163b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:09.406229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ea304-492c-46e3-8100-df0c1bb163b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:09.407078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ea304-492c-46e3-8100-df0c1bb163b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:09.408631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ea304-492c-46e3-8100-df0c1bb163b2 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:09.410251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b76c3-15ba-46d5-abea-30aa03d23a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:09.410943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b76c3-15ba-46d5-abea-30aa03d23a53 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:09.411299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b76c3-15ba-46d5-abea-30aa03d23a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:09.411719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b76c3-15ba-46d5-abea-30aa03d23a53 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:09.412460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b76c3-15ba-46d5-abea-30aa03d23a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:09.414051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b76c3-15ba-46d5-abea-30aa03d23a53 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:09.421929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 466/919] 10.222.0.61 () {56 vars in 1087 bytes} [Thu Sep 22 18:13:09 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:13:09.437633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 454/920] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:13:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:09.513200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b76c3-15ba-46d5-abea-30aa03d23a53 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:09.627367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:09.638414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b76c3-15ba-46d5-abea-30aa03d23a53 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:09.694543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bd401-4284-45ea-8fed-40546653ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:09.695201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bd401-4284-45ea-8fed-40546653ea3b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:09.695460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bd401-4284-45ea-8fed-40546653ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:09.695735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bd401-4284-45ea-8fed-40546653ea3b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:09.696315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bd401-4284-45ea-8fed-40546653ea3b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:09.697720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bd401-4284-45ea-8fed-40546653ea3b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-be9bd401-4284-45ea-8fed-40546653ea3b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:09.707625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:09.708635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:09.709486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:09.711570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 467/921] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:09.715385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ea304-492c-46e3-8100-df0c1bb163b2 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:09.803771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:09.831058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ea304-492c-46e3-8100-df0c1bb163b2 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:09.867891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e758d-5168-4909-9dae-7bd43c74c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:09.868889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e758d-5168-4909-9dae-7bd43c74c11e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:09.869406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e758d-5168-4909-9dae-7bd43c74c11e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:09.869883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e758d-5168-4909-9dae-7bd43c74c11e None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:09.870743 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e758d-5168-4909-9dae-7bd43c74c11e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:09.871249 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e758d-5168-4909-9dae-7bd43c74c11e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:09.872833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e758d-5168-4909-9dae-7bd43c74c11e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:09.879105 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 455/922] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:09.889269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bd401-4284-45ea-8fed-40546653ea3b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:10.005482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bd401-4284-45ea-8fed-40546653ea3b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:10.043871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feb7af-4075-4420-8055-b4ea374c64c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:10.044487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feb7af-4075-4420-8055-b4ea374c64c1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:10.044769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feb7af-4075-4420-8055-b4ea374c64c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:10.045046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feb7af-4075-4420-8055-b4ea374c64c1 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:10.045723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feb7af-4075-4420-8055-b4ea374c64c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:10.046032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feb7af-4075-4420-8055-b4ea374c64c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:10.048040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feb7af-4075-4420-8055-b4ea374c64c1 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:10.053661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 468/923] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:10.059483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e758d-5168-4909-9dae-7bd43c74c11e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:10.114639 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc657f-94cb-46c9-98af-cf84a02b5f77 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:10.114964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc657f-94cb-46c9-98af-cf84a02b5f77 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:10.115192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc657f-94cb-46c9-98af-cf84a02b5f77 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:10.116681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 469/924] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:10.121838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909e6f7-a9fc-48d4-8946-a515f6e82d4c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:10.122122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909e6f7-a9fc-48d4-8946-a515f6e82d4c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:10.122398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909e6f7-a9fc-48d4-8946-a515f6e82d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:10.144212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-2909e6f7-a9fc-48d4-8946-a515f6e82d4c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:10.146282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2909e6f7-a9fc-48d4-8946-a515f6e82d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:10.158258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:10.177772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e758d-5168-4909-9dae-7bd43c74c11e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:10.219678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008faac-4c07-436e-88da-099c675e461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:10.220579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008faac-4c07-436e-88da-099c675e461e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:10.221359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008faac-4c07-436e-88da-099c675e461e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:10.221642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008faac-4c07-436e-88da-099c675e461e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:10.222584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008faac-4c07-436e-88da-099c675e461e None admin] RBAC: Adding query filter params (interface=public, service_id=be719240f9774e19863bbc5ad350be7c, region_id=RegionOne) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:10.222957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008faac-4c07-436e-88da-099c675e461e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:10.224557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008faac-4c07-436e-88da-099c675e461e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:10.230987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 456/925] 10.222.0.61 () {56 vars in 1251 bytes} [Thu Sep 22 18:13:10 2022] GET /identity/v3/endpoints?service_id=be719240f9774e19863bbc5ad350be7c&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:10.234032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 470/926] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:10.236481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008faac-4c07-436e-88da-099c675e461e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:10.253840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:10.349571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008faac-4c07-436e-88da-099c675e461e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:10.385869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a105a-bd70-4d8b-b489-a4eca3ce1388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:10.386830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a105a-bd70-4d8b-b489-a4eca3ce1388 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:10.387317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a105a-bd70-4d8b-b489-a4eca3ce1388 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:10.387794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a105a-bd70-4d8b-b489-a4eca3ce1388 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:10.388597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a105a-bd70-4d8b-b489-a4eca3ce1388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:10.390742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a105a-bd70-4d8b-b489-a4eca3ce1388 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:10.397477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 457/927] 10.222.0.61 () {56 vars in 1087 bytes} [Thu Sep 22 18:13:10 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:13:10.514289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909e6f7-a9fc-48d4-8946-a515f6e82d4c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:10.626816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909e6f7-a9fc-48d4-8946-a515f6e82d4c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:10.666558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c331e-073a-4141-811a-19be1f5898f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:10.667576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c331e-073a-4141-811a-19be1f5898f8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:10.668061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c331e-073a-4141-811a-19be1f5898f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:10.668548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c331e-073a-4141-811a-19be1f5898f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:10.680975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c331e-073a-4141-811a-19be1f5898f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-583c331e-073a-4141-811a-19be1f5898f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:10.685913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:10.686802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:10.687706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 471/928] 10.222.0.61 () {56 vars in 1120 bytes} [Thu Sep 22 18:13:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:10.693281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a105a-bd70-4d8b-b489-a4eca3ce1388 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:10.767514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:10.801677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a105a-bd70-4d8b-b489-a4eca3ce1388 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:10.841934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8408c1-5596-4180-8fa7-d47c250c73f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:10.843876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8408c1-5596-4180-8fa7-d47c250c73f3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:10.844364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8408c1-5596-4180-8fa7-d47c250c73f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:10.844839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8408c1-5596-4180-8fa7-d47c250c73f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:10.845764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8408c1-5596-4180-8fa7-d47c250c73f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:10.846288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8408c1-5596-4180-8fa7-d47c250c73f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:10.847937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8408c1-5596-4180-8fa7-d47c250c73f3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:10.857120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 458/929] 10.222.0.61 () {56 vars in 1115 bytes} [Thu Sep 22 18:13:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:10.868023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c331e-073a-4141-811a-19be1f5898f8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:10.872843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:10.979378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c331e-073a-4141-811a-19be1f5898f8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:11.014178 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b7136-6bf0-47bf-a348-d925bcd6263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:11.014816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b7136-6bf0-47bf-a348-d925bcd6263d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.015158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b7136-6bf0-47bf-a348-d925bcd6263d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.015434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b7136-6bf0-47bf-a348-d925bcd6263d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.025666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b7136-6bf0-47bf-a348-d925bcd6263d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:11.027120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b7136-6bf0-47bf-a348-d925bcd6263d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-362b7136-6bf0-47bf-a348-d925bcd6263d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:11.043726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:11.044719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:11.045657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:11.045657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:11.045657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:11.050439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 472/930] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:11.052535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8408c1-5596-4180-8fa7-d47c250c73f3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:11.160955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8408c1-5596-4180-8fa7-d47c250c73f3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:11.190964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:11.196890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd41c81-eaca-4daf-8be6-eab7764c8b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:11.197543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41c81-eaca-4daf-8be6-eab7764c8b9c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.197822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41c81-eaca-4daf-8be6-eab7764c8b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.198094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41c81-eaca-4daf-8be6-eab7764c8b9c None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.198748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd41c81-eaca-4daf-8be6-eab7764c8b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:11.199049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd41c81-eaca-4daf-8be6-eab7764c8b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:11.200423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd41c81-eaca-4daf-8be6-eab7764c8b9c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:11.214005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 459/931] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:11.219982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b7136-6bf0-47bf-a348-d925bcd6263d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:11.281670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:11.330548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b7136-6bf0-47bf-a348-d925bcd6263d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:11.367168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da8847-43fa-4e1b-a01e-a572433e049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:11.367834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da8847-43fa-4e1b-a01e-a572433e049d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.368119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da8847-43fa-4e1b-a01e-a572433e049d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.368397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da8847-43fa-4e1b-a01e-a572433e049d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.377874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da8847-43fa-4e1b-a01e-a572433e049d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:11.379438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da8847-43fa-4e1b-a01e-a572433e049d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-b0da8847-43fa-4e1b-a01e-a572433e049d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:13:11.401444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:11.402428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:11.403357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 473/932] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:13:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:11.409474 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd41c81-eaca-4daf-8be6-eab7764c8b9c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:11.517439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd41c81-eaca-4daf-8be6-eab7764c8b9c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:11.553702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094787aa-4958-449c-bbe6-4fbb6931ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:11.554240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094787aa-4958-449c-bbe6-4fbb6931ad1a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.554522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094787aa-4958-449c-bbe6-4fbb6931ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.554802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094787aa-4958-449c-bbe6-4fbb6931ad1a None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.555540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094787aa-4958-449c-bbe6-4fbb6931ad1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:11.555843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094787aa-4958-449c-bbe6-4fbb6931ad1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:11.557270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094787aa-4958-449c-bbe6-4fbb6931ad1a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:11.576014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 460/933] 10.222.0.61 () {56 vars in 1149 bytes} [Thu Sep 22 18:13:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:11.581536 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da8847-43fa-4e1b-a01e-a572433e049d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:11.696578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da8847-43fa-4e1b-a01e-a572433e049d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:11.715779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:11.740894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0120-5e7f-41fd-ae5d-adaf48721334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:11.741667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0120-5e7f-41fd-ae5d-adaf48721334 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.741951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0120-5e7f-41fd-ae5d-adaf48721334 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.742227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0120-5e7f-41fd-ae5d-adaf48721334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.755427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f0120-5e7f-41fd-ae5d-adaf48721334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:11.756972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f0120-5e7f-41fd-ae5d-adaf48721334 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-200f0120-5e7f-41fd-ae5d-adaf48721334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:11.772912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:11.773973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:11.774868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:11.774868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:11.774868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:11.774868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 474/934] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:11.778160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474db2a-f4c7-4dc1-a3ac-16ef608d31f1 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.778703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474db2a-f4c7-4dc1-a3ac-16ef608d31f1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.779215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474db2a-f4c7-4dc1-a3ac-16ef608d31f1 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.779897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0120-5e7f-41fd-ae5d-adaf48721334 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:11.781807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 461/935] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:11.787449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43745e6-e42b-436b-9702-837a932b19b3 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.788034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43745e6-e42b-436b-9702-837a932b19b3 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.788516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43745e6-e42b-436b-9702-837a932b19b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.809069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e43745e6-e42b-436b-9702-837a932b19b3 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:11.810810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e43745e6-e42b-436b-9702-837a932b19b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:11.867162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:11.896329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 462/936] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:11.897794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819322fa-9f1b-4844-89de-882b50e45265 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.898151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819322fa-9f1b-4844-89de-882b50e45265 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.898501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819322fa-9f1b-4844-89de-882b50e45265 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.900017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 463/937] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:11.905383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98523efe-df67-45ec-9ee1-55dda922220d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.905684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98523efe-df67-45ec-9ee1-55dda922220d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.906547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98523efe-df67-45ec-9ee1-55dda922220d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.911379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0120-5e7f-41fd-ae5d-adaf48721334 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:11.926367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-98523efe-df67-45ec-9ee1-55dda922220d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:11.927358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-98523efe-df67-45ec-9ee1-55dda922220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:11.961308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1b3d2-5616-4805-9bc0-681f124fa91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:11.961928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1b3d2-5616-4805-9bc0-681f124fa91e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:11.962209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1b3d2-5616-4805-9bc0-681f124fa91e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:11.962482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1b3d2-5616-4805-9bc0-681f124fa91e None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:11.963375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1b3d2-5616-4805-9bc0-681f124fa91e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:11.963916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1b3d2-5616-4805-9bc0-681f124fa91e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:11.965056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1b3d2-5616-4805-9bc0-681f124fa91e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:11.982811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 475/938] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:11.983593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1b3d2-5616-4805-9bc0-681f124fa91e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.012759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:12.016178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 464/939] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:12.097161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1b3d2-5616-4805-9bc0-681f124fa91e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:12.133532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615c4ca-669e-427c-91b2-ca7d5426d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:12.134451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615c4ca-669e-427c-91b2-ca7d5426d41a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.134889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615c4ca-669e-427c-91b2-ca7d5426d41a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.135315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615c4ca-669e-427c-91b2-ca7d5426d41a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.143322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615c4ca-669e-427c-91b2-ca7d5426d41a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:12.144948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615c4ca-669e-427c-91b2-ca7d5426d41a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-4615c4ca-669e-427c-91b2-ca7d5426d41a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:13:12.157376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:12.158433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:12.159575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:13:12.159575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:13:12.159575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:13:12.159575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:13:12.159575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:13:12.159575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:13:12.159575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:12.159575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.161545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 476/940] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:12.167509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98523efe-df67-45ec-9ee1-55dda922220d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.173582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615c4ca-669e-427c-91b2-ca7d5426d41a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.273587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:12.288558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615c4ca-669e-427c-91b2-ca7d5426d41a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:12.305691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98523efe-df67-45ec-9ee1-55dda922220d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:12.320602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:12.326363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c4579-d9ec-4658-8229-bd0b3b85da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:12.327285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c4579-d9ec-4658-8229-bd0b3b85da3f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.328428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c4579-d9ec-4658-8229-bd0b3b85da3f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.328772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c4579-d9ec-4658-8229-bd0b3b85da3f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.329394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c4579-d9ec-4658-8229-bd0b3b85da3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:12.330765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c4579-d9ec-4658-8229-bd0b3b85da3f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-0f0c4579-d9ec-4658-8229-bd0b3b85da3f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:12.340332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:12.341331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.347812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 477/941] 10.222.0.61 () {56 vars in 1132 bytes} [Thu Sep 22 18:13:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:12.348622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c4579-d9ec-4658-8229-bd0b3b85da3f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.355130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc41bd-a8ca-40a6-a5e5-ea582d90308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:12.355748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc41bd-a8ca-40a6-a5e5-ea582d90308b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.356026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc41bd-a8ca-40a6-a5e5-ea582d90308b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.356305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc41bd-a8ca-40a6-a5e5-ea582d90308b None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.357006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc41bd-a8ca-40a6-a5e5-ea582d90308b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:12.357351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc41bd-a8ca-40a6-a5e5-ea582d90308b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:12.358803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc41bd-a8ca-40a6-a5e5-ea582d90308b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:12.376434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 465/942] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:12.376434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc41bd-a8ca-40a6-a5e5-ea582d90308b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.459802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c4579-d9ec-4658-8229-bd0b3b85da3f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:12.490008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc41bd-a8ca-40a6-a5e5-ea582d90308b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:12.496622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:12.497393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.497680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.497957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.498598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:12.500686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:12.503554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING keystone.server.flask.common [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 22 18:13:12.524358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.sql.core [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 18:13:12.524358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 18:13:12.524358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [parameters: {'id': '1c35f73366e14748b533aef719cab414', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 18:13:12.524358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81342) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 18:13:12.525221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa3ee-cc19-4c41-a1c8-04a76f89f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:12.525937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa3ee-cc19-4c41-a1c8-04a76f89f935 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.526358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa3ee-cc19-4c41-a1c8-04a76f89f935 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.526623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa3ee-cc19-4c41-a1c8-04a76f89f935 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.527326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faa3ee-cc19-4c41-a1c8-04a76f89f935 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:12.527697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faa3ee-cc19-4c41-a1c8-04a76f89f935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:12.529151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faa3ee-cc19-4c41-a1c8-04a76f89f935 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:12.539047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 466/943] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:12.539047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa3ee-cc19-4c41-a1c8-04a76f89f935 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1c35f73366e14748b533aef719cab414.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1c35f73366e14748b533aef719cab414. Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application conn.query(q) Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 18:13:12.540763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application result.read() Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 22 18:13:12.541610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application next(self.gen) Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application yield resource Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application next(self.gen) Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise self.value Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application session.commit() Sep 22 18:13:12.542589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.session.flush() Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application compat.raise_( Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 18:13:12.544130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 18:13:12.546460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application conn.query(q) Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application result.read() Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 18:13:12.548405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [parameters: {'id': '1c35f73366e14748b533aef719cab414', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:12.550485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:12.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1c35f73366e14748b533aef719cab414. Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 478/944] 10.222.0.61 () {60 vars in 1140 bytes} [Thu Sep 22 18:13:12 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:12.554648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.564907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:12.585524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:12.667043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa3ee-cc19-4c41-a1c8-04a76f89f935 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:12.672983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b70b0a-587e-4c65-8b19-28ddafb34649 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:12.708521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdee23d-4741-4405-a779-ef1b2207d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:12.709190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdee23d-4741-4405-a779-ef1b2207d6e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.709504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdee23d-4741-4405-a779-ef1b2207d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.709784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdee23d-4741-4405-a779-ef1b2207d6e5 None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/99c9b7ef3a7345879747a2193ad8044c/roles/9d1b8b0e878a4d08ab0b856406a139ad` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.712020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdee23d-4741-4405-a779-ef1b2207d6e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=99c9b7ef3a7345879747a2193ad8044c, role_id=9d1b8b0e878a4d08ab0b856406a139ad)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:12.712320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838136b-cd17-4cd1-b10c-732ee5e0e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:12.712949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838136b-cd17-4cd1-b10c-732ee5e0e2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.713516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838136b-cd17-4cd1-b10c-732ee5e0e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.713773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdee23d-4741-4405-a779-ef1b2207d6e5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:12.713870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838136b-cd17-4cd1-b10c-732ee5e0e2e2 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.714417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838136b-cd17-4cd1-b10c-732ee5e0e2e2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:12.714726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838136b-cd17-4cd1-b10c-732ee5e0e2e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:12.716301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838136b-cd17-4cd1-b10c-732ee5e0e2e2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:12.726867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 479/945] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:12.727811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838136b-cd17-4cd1-b10c-732ee5e0e2e2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.730176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 467/946] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:13:12 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/99c9b7ef3a7345879747a2193ad8044c/roles/9d1b8b0e878a4d08ab0b856406a139ad => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:13:12.733279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b400feb-60a3-413b-ba3c-f1367aebeaca None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.733716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b400feb-60a3-413b-ba3c-f1367aebeaca None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.734707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b400feb-60a3-413b-ba3c-f1367aebeaca None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.741937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 468/947] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:12.741937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b400feb-60a3-413b-ba3c-f1367aebeaca None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.817781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:12.852696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:12.855865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838136b-cd17-4cd1-b10c-732ee5e0e2e2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:12.862366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b400feb-60a3-413b-ba3c-f1367aebeaca None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:12.897087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21fb23-4f5e-4d7d-8998-89a6b78c73b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:12.898025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21fb23-4f5e-4d7d-8998-89a6b78c73b2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.898461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21fb23-4f5e-4d7d-8998-89a6b78c73b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.898919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21fb23-4f5e-4d7d-8998-89a6b78c73b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.900705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7de6e3-26b6-4238-8f3e-bdc68d5fd2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:12.901352 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de6e3-26b6-4238-8f3e-bdc68d5fd2d4 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.901674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de6e3-26b6-4238-8f3e-bdc68d5fd2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.901912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de6e3-26b6-4238-8f3e-bdc68d5fd2d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.904010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7de6e3-26b6-4238-8f3e-bdc68d5fd2d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:12.904628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7de6e3-26b6-4238-8f3e-bdc68d5fd2d4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:12.909638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21fb23-4f5e-4d7d-8998-89a6b78c73b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:12.911084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21fb23-4f5e-4d7d-8998-89a6b78c73b2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-cf21fb23-4f5e-4d7d-8998-89a6b78c73b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:13:12.926440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:12.927917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:12.928885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:13:12.928885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:13:12.928885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:13:12.928885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:13:12.928885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:13:12.928885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:13:12.928885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:12.928885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:12.928885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 480/948] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:12.930129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62e4e0-ea39-4908-b0af-327aac89032b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:12.930419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62e4e0-ea39-4908-b0af-327aac89032b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:12.930727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62e4e0-ea39-4908-b0af-327aac89032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:12.935747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 469/949] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:13:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:12.937343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7de6e3-26b6-4238-8f3e-bdc68d5fd2d4 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:12.956071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-df62e4e0-ea39-4908-b0af-327aac89032b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:12.959394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-df62e4e0-ea39-4908-b0af-327aac89032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:13.070646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 481/950] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:13.079747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7de6e3-26b6-4238-8f3e-bdc68d5fd2d4 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:13.118807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256c5b-3eca-4dd8-a3a5-a0e881a99d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:13.120911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256c5b-3eca-4dd8-a3a5-a0e881a99d8d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:13.120911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256c5b-3eca-4dd8-a3a5-a0e881a99d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:13.120911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256c5b-3eca-4dd8-a3a5-a0e881a99d8d None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:13.120911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f256c5b-3eca-4dd8-a3a5-a0e881a99d8d None admin] RBAC: Adding query filter params (name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:13.121401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f256c5b-3eca-4dd8-a3a5-a0e881a99d8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:13.123398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f256c5b-3eca-4dd8-a3a5-a0e881a99d8d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:13.143634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 470/951] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:13:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:13.346130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62e4e0-ea39-4908-b0af-327aac89032b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:13.409522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:13.456233 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62e4e0-ea39-4908-b0af-327aac89032b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:13.493560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d30e66-2cbc-44f4-b118-dac88dba7b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:13.494216 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d30e66-2cbc-44f4-b118-dac88dba7b2c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:13.494502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d30e66-2cbc-44f4-b118-dac88dba7b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:13.494774 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d30e66-2cbc-44f4-b118-dac88dba7b2c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:13.495430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d30e66-2cbc-44f4-b118-dac88dba7b2c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:13.496810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d30e66-2cbc-44f4-b118-dac88dba7b2c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-50d30e66-2cbc-44f4-b118-dac88dba7b2c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:13.506136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:13.507529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:13.508637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 482/952] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:13.517176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256c5b-3eca-4dd8-a3a5-a0e881a99d8d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:13.529970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:13.633335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256c5b-3eca-4dd8-a3a5-a0e881a99d8d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:13.672976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166581c-64a8-4eef-b15f-2c4c6fc39cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:13.673892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166581c-64a8-4eef-b15f-2c4c6fc39cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:13.674324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166581c-64a8-4eef-b15f-2c4c6fc39cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:13.674765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166581c-64a8-4eef-b15f-2c4c6fc39cb3 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:13.675553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166581c-64a8-4eef-b15f-2c4c6fc39cb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:13.676008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166581c-64a8-4eef-b15f-2c4c6fc39cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:13.677562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166581c-64a8-4eef-b15f-2c4c6fc39cb3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:13.683879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 471/953] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:13.690223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d30e66-2cbc-44f4-b118-dac88dba7b2c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:13.799022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d30e66-2cbc-44f4-b118-dac88dba7b2c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:13.823994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:13.836571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb8ebf-6e2d-4106-b559-c648b4a20934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:13.837202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb8ebf-6e2d-4106-b559-c648b4a20934 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:13.837521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb8ebf-6e2d-4106-b559-c648b4a20934 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:13.837797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb8ebf-6e2d-4106-b559-c648b4a20934 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:13.838760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb8ebf-6e2d-4106-b559-c648b4a20934 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:13.839071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb8ebf-6e2d-4106-b559-c648b4a20934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:13.840511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb8ebf-6e2d-4106-b559-c648b4a20934 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:13.847084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 483/954] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:13.853038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166581c-64a8-4eef-b15f-2c4c6fc39cb3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:13.933971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:13.968020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166581c-64a8-4eef-b15f-2c4c6fc39cb3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:14.005222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67473f0d-8a89-4356-b3b5-472401bbff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:14.005877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67473f0d-8a89-4356-b3b5-472401bbff60 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:14.006158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67473f0d-8a89-4356-b3b5-472401bbff60 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:14.006431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67473f0d-8a89-4356-b3b5-472401bbff60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:14.007117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67473f0d-8a89-4356-b3b5-472401bbff60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:14.008494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67473f0d-8a89-4356-b3b5-472401bbff60 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:14.030587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 472/955] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:13:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:14.914610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a32eb0-8c17-45b9-bf00-a84619407b3a None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:14.915118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a32eb0-8c17-45b9-bf00-a84619407b3a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:14.915118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a32eb0-8c17-45b9-bf00-a84619407b3a None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:14.916852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 484/956] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:14.922712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e0d17-cd67-4060-ae36-00b90d9c8b34 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:14.922996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e0d17-cd67-4060-ae36-00b90d9c8b34 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:14.923270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e0d17-cd67-4060-ae36-00b90d9c8b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:14.941825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-982e0d17-cd67-4060-ae36-00b90d9c8b34 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:14.942940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-982e0d17-cd67-4060-ae36-00b90d9c8b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:15.033353 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 473/957] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:15.218069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9412-ab50-4dbb-9c7b-9caef4cda675 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:15.218921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9412-ab50-4dbb-9c7b-9caef4cda675 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:15.219279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9412-ab50-4dbb-9c7b-9caef4cda675 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:15.220918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 485/958] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:15.225976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd047e2d-4f62-4b14-a4c1-580a03300107 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:15.226265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd047e2d-4f62-4b14-a4c1-580a03300107 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:15.226538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd047e2d-4f62-4b14-a4c1-580a03300107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:15.245125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-bd047e2d-4f62-4b14-a4c1-580a03300107 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:15.246372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-bd047e2d-4f62-4b14-a4c1-580a03300107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:15.295477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:15.298377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c9412-ab50-4dbb-9c7b-9caef4cda675 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:15.320172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 474/959] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:15.413367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c9412-ab50-4dbb-9c7b-9caef4cda675 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:15.451895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffd399-44c4-4da4-8cbf-f2a7e00a7c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:15.452651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffd399-44c4-4da4-8cbf-f2a7e00a7c3d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:15.452942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffd399-44c4-4da4-8cbf-f2a7e00a7c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:15.453295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffd399-44c4-4da4-8cbf-f2a7e00a7c3d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:15.465084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffd399-44c4-4da4-8cbf-f2a7e00a7c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-94ffd399-44c4-4da4-8cbf-f2a7e00a7c3d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:15.470668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:15.471671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:15.472524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 486/960] 10.222.0.61 () {56 vars in 1120 bytes} [Thu Sep 22 18:13:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:15.478062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd047e2d-4f62-4b14-a4c1-580a03300107 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:15.532931 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ffd9-c114-419c-a31d-4ec47aeb9dbb None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:15.533623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ffd9-c114-419c-a31d-4ec47aeb9dbb None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:15.534112 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ffd9-c114-419c-a31d-4ec47aeb9dbb None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:15.535948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 487/961] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:15.540977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371285c-7c05-4464-9d50-fd912c97eb95 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:15.541385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371285c-7c05-4464-9d50-fd912c97eb95 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:15.541745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371285c-7c05-4464-9d50-fd912c97eb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:15.560503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f371285c-7c05-4464-9d50-fd912c97eb95 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:15.561872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f371285c-7c05-4464-9d50-fd912c97eb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:15.582861 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd047e2d-4f62-4b14-a4c1-580a03300107 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:15.610051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:15.621361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be28522-7786-43ad-a795-83989c51a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:15.621993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be28522-7786-43ad-a795-83989c51a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:15.622339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be28522-7786-43ad-a795-83989c51a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:15.622723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be28522-7786-43ad-a795-83989c51a7c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:15.623400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be28522-7786-43ad-a795-83989c51a7c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:15.623707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be28522-7786-43ad-a795-83989c51a7c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:15.625108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be28522-7786-43ad-a795-83989c51a7c1 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:15.637423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 475/962] 10.222.0.61 () {56 vars in 1115 bytes} [Thu Sep 22 18:13:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:15.637423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be28522-7786-43ad-a795-83989c51a7c1 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:15.643253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 488/963] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:15.643954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371285c-7c05-4464-9d50-fd912c97eb95 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:15.703249 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:15.768774 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371285c-7c05-4464-9d50-fd912c97eb95 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:15.776344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be28522-7786-43ad-a795-83989c51a7c1 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:15.808486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bba565-1909-4bc5-923c-addd4c4d502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:15.809138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bba565-1909-4bc5-923c-addd4c4d502b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:15.809448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bba565-1909-4bc5-923c-addd4c4d502b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:15.809723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bba565-1909-4bc5-923c-addd4c4d502b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:15.820655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba2b9c-a6e1-41a2-84c3-f778fa7cbf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:15.821867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2b9c-a6e1-41a2-84c3-f778fa7cbf44 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:15.821994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bba565-1909-4bc5-923c-addd4c4d502b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:15.822467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2b9c-a6e1-41a2-84c3-f778fa7cbf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:15.823015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2b9c-a6e1-41a2-84c3-f778fa7cbf44 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:15.823338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bba565-1909-4bc5-923c-addd4c4d502b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:15.824168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba2b9c-a6e1-41a2-84c3-f778fa7cbf44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:15.826198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba2b9c-a6e1-41a2-84c3-f778fa7cbf44 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-93ba2b9c-a6e1-41a2-84c3-f778fa7cbf44 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:15.837019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:15.838118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 18:13:15.839207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-c0bba565-1909-4bc5-923c-addd4c4d502b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:15.839938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:15.840753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:15.843013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:15.843013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:15.843013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:15.845727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 489/965] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:15.845940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 476/965] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:15.850571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bba565-1909-4bc5-923c-addd4c4d502b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:15.851617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba2b9c-a6e1-41a2-84c3-f778fa7cbf44 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:15.882051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:15.959752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bba565-1909-4bc5-923c-addd4c4d502b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:15.964948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba2b9c-a6e1-41a2-84c3-f778fa7cbf44 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:15.977476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:15.996937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f215-40da-44ee-b64d-ff369dbe830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:15.997597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f215-40da-44ee-b64d-ff369dbe830c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:15.997870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f215-40da-44ee-b64d-ff369dbe830c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:15.998310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f215-40da-44ee-b64d-ff369dbe830c None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:15.998782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f215-40da-44ee-b64d-ff369dbe830c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:15.999091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f215-40da-44ee-b64d-ff369dbe830c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:16.000996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f215-40da-44ee-b64d-ff369dbe830c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:16.006684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5763-0cf6-4420-a814-f3fee88041aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:16.007302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5763-0cf6-4420-a814-f3fee88041aa None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.007584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5763-0cf6-4420-a814-f3fee88041aa None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.007855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5763-0cf6-4420-a814-f3fee88041aa None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.008479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5763-0cf6-4420-a814-f3fee88041aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:16.008784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5763-0cf6-4420-a814-f3fee88041aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:16.010180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5763-0cf6-4420-a814-f3fee88041aa None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:16.013174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 490/966] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:16.014211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f215-40da-44ee-b64d-ff369dbe830c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:16.020616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 477/967] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:13:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:16.021631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5763-0cf6-4420-a814-f3fee88041aa None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:16.111441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:16.125146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f215-40da-44ee-b64d-ff369dbe830c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:16.128005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5763-0cf6-4420-a814-f3fee88041aa None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:16.161436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:16.162035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.162346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.162578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.163208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:16.164653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:16.165427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eceee-ca5f-4218-9f32-657cbabad4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:16.166218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eceee-ca5f-4218-9f32-657cbabad4ea None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.166659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eceee-ca5f-4218-9f32-657cbabad4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.167077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eceee-ca5f-4218-9f32-657cbabad4ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.174933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eceee-ca5f-4218-9f32-657cbabad4ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:16.176372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eceee-ca5f-4218-9f32-657cbabad4ea None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:16.180865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.sql.core [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 18:13:16.180865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 18:13:16.180865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [parameters: {'user_id': 'c3166fc80d7c4436bb56a19cc33f5273', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 18:13:16.180865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81342) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application conn.query(q) Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application result.read() Sep 22 18:13:16.188008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 18:13:16.188921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application next(self.gen) Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application yield resource Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application next(self.gen) Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise self.value Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application session.commit() Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 18:13:16.195129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.session.flush() Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application compat.raise_( Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 18:13:16.196200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 18:13:16.197737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application conn.query(q) Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application result.read() Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 18:13:16.198570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c3166fc80d7c4436bb56a19cc33f5273', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:16.199435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 22 18:13:16.200294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 22 18:13:16.201670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 22 18:13:16.201670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 22 18:13:16.201670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 18:13:16.201670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 18:13:16.201670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 18:13:16.201670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:16.201670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 491/968] 10.222.0.61 () {60 vars in 1131 bytes} [Thu Sep 22 18:13:16 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-e62eceee-ca5f-4218-9f32-657cbabad4ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:13:16.202110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:16.206286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 18:13:16.208522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:16.209893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:16.210045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 478/969] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:13:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:16.210045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eceee-ca5f-4218-9f32-657cbabad4ea None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:16.236706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:16.320505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eceee-ca5f-4218-9f32-657cbabad4ea None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:16.320802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781906-8235-4907-ae28-e4e89e96cb53 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:16.356015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4c2c8-dc34-43e3-8741-ccd8823289d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:16.356374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695c710-0285-4bcf-8faa-ed66b255a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:16.356654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4c2c8-dc34-43e3-8741-ccd8823289d3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.356937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4c2c8-dc34-43e3-8741-ccd8823289d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.357031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c710-0285-4bcf-8faa-ed66b255a2ad None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.357212 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4c2c8-dc34-43e3-8741-ccd8823289d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.357347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c710-0285-4bcf-8faa-ed66b255a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.357548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c710-0285-4bcf-8faa-ed66b255a2ad None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.358174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695c710-0285-4bcf-8faa-ed66b255a2ad None admin] RBAC: Adding query filter params (type=compute) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:16.358479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695c710-0285-4bcf-8faa-ed66b255a2ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:16.360578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695c710-0285-4bcf-8faa-ed66b255a2ad None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:16.365346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4c2c8-dc34-43e3-8741-ccd8823289d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:16.366772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4c2c8-dc34-43e3-8741-ccd8823289d3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:16.367914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 492/970] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:13:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:16.368929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695c710-0285-4bcf-8faa-ed66b255a2ad None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-8cb4c2c8-dc34-43e3-8741-ccd8823289d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:13:16.379076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:16.380126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 18:13:16.381075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:16.385457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 479/971] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:13:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:16.386728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2894d-6a7c-4ea2-911d-6f3bb5f76148 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.387021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2894d-6a7c-4ea2-911d-6f3bb5f76148 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.387302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2894d-6a7c-4ea2-911d-6f3bb5f76148 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.388864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 480/972] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:16.389672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2894d-6a7c-4ea2-911d-6f3bb5f76148 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:16.396584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:16.500731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:16.508712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695c710-0285-4bcf-8faa-ed66b255a2ad None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:16.512816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2894d-6a7c-4ea2-911d-6f3bb5f76148 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:16.551640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595293-57ac-4146-adab-da48229b7a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:16.551879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226d197-4266-4c0e-ba45-4953bd43915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:16.552952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595293-57ac-4146-adab-da48229b7a0d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.553073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226d197-4266-4c0e-ba45-4953bd43915e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.553152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595293-57ac-4146-adab-da48229b7a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.553257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226d197-4266-4c0e-ba45-4953bd43915e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.553337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595293-57ac-4146-adab-da48229b7a0d None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.553422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226d197-4266-4c0e-ba45-4953bd43915e None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.553494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595293-57ac-4146-adab-da48229b7a0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:16.553706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226d197-4266-4c0e-ba45-4953bd43915e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:16.553803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595293-57ac-4146-adab-da48229b7a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:16.554346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226d197-4266-4c0e-ba45-4953bd43915e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:16.555278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595293-57ac-4146-adab-da48229b7a0d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:16.555451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226d197-4266-4c0e-ba45-4953bd43915e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:16.576159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 493/973] 10.222.0.61 () {56 vars in 1149 bytes} [Thu Sep 22 18:13:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:16.577290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3cb8-db11-43c2-94ab-41bf1e21b754 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.577618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3cb8-db11-43c2-94ab-41bf1e21b754 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.577895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3cb8-db11-43c2-94ab-41bf1e21b754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.593021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 481/974] 10.222.0.61 () {56 vars in 1101 bytes} [Thu Sep 22 18:13:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:16.594331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226d197-4266-4c0e-ba45-4953bd43915e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:16.597019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-169e3cb8-db11-43c2-94ab-41bf1e21b754 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:16.598662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-169e3cb8-db11-43c2-94ab-41bf1e21b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:16.678520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 494/975] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:16.730595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226d197-4266-4c0e-ba45-4953bd43915e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:16.771577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0717b-4aca-423b-a96e-9bb1de2c0855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:16.772607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0717b-4aca-423b-a96e-9bb1de2c0855 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:16.773097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0717b-4aca-423b-a96e-9bb1de2c0855 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:16.773603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0717b-4aca-423b-a96e-9bb1de2c0855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:16.795251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:16.854117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0717b-4aca-423b-a96e-9bb1de2c0855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:16.855569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0717b-4aca-423b-a96e-9bb1de2c0855 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:16.962859 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 482/976] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:16 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:13:16.968938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0717b-4aca-423b-a96e-9bb1de2c0855 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:16.969629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3cb8-db11-43c2-94ab-41bf1e21b754 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:16.972131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:17.022440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:17.074256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3cb8-db11-43c2-94ab-41bf1e21b754 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.076685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0717b-4aca-423b-a96e-9bb1de2c0855 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.110831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475209fa-d5ca-4c90-bfbc-89652ee25c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.111368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475209fa-d5ca-4c90-bfbc-89652ee25c17 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.111650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475209fa-d5ca-4c90-bfbc-89652ee25c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.111977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475209fa-d5ca-4c90-bfbc-89652ee25c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.113123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84fea8-31de-463f-8f4f-8e5a284ea99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.113815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84fea8-31de-463f-8f4f-8e5a284ea99f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.114099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84fea8-31de-463f-8f4f-8e5a284ea99f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.114377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84fea8-31de-463f-8f4f-8e5a284ea99f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.114967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84fea8-31de-463f-8f4f-8e5a284ea99f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.116341 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84fea8-31de-463f-8f4f-8e5a284ea99f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.122729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475209fa-d5ca-4c90-bfbc-89652ee25c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.124172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475209fa-d5ca-4c90-bfbc-89652ee25c17 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-df84fea8-31de-463f-8f4f-8e5a284ea99f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:17.125815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:17.126768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:17.127621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 483/977] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:17.132738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84fea8-31de-463f-8f4f-8e5a284ea99f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-475209fa-d5ca-4c90-bfbc-89652ee25c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:17.143471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:17.144469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:17.145443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:17.145443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:17.145443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:17.145443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 495/978] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:17.150457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475209fa-d5ca-4c90-bfbc-89652ee25c17 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:17.216632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:17.247668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84fea8-31de-463f-8f4f-8e5a284ea99f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.265953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:17.271083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475209fa-d5ca-4c90-bfbc-89652ee25c17 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.294331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12159ca4-cc78-4951-aeec-69405e3fc330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.295277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12159ca4-cc78-4951-aeec-69405e3fc330 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.295574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12159ca4-cc78-4951-aeec-69405e3fc330 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.295854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12159ca4-cc78-4951-aeec-69405e3fc330 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.297398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12159ca4-cc78-4951-aeec-69405e3fc330 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:17.298148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12159ca4-cc78-4951-aeec-69405e3fc330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.299791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12159ca4-cc78-4951-aeec-69405e3fc330 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.311194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 484/979] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:17.311374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6a44-15b4-41ff-a7a1-94173bbe524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.311374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6a44-15b4-41ff-a7a1-94173bbe524d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.311374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6a44-15b4-41ff-a7a1-94173bbe524d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.311374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6a44-15b4-41ff-a7a1-94173bbe524d None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.311683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c6a44-15b4-41ff-a7a1-94173bbe524d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:17.311683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c6a44-15b4-41ff-a7a1-94173bbe524d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.312771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12159ca4-cc78-4951-aeec-69405e3fc330 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:17.313029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c6a44-15b4-41ff-a7a1-94173bbe524d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.326823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 496/980] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:17.332163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6a44-15b4-41ff-a7a1-94173bbe524d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:17.423594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12159ca4-cc78-4951-aeec-69405e3fc330 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.441339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6a44-15b4-41ff-a7a1-94173bbe524d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.456141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:17.463616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49be90-6893-4331-b09c-a68eefc6cbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.464248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49be90-6893-4331-b09c-a68eefc6cbdf None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.464869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49be90-6893-4331-b09c-a68eefc6cbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.464869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49be90-6893-4331-b09c-a68eefc6cbdf None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.465495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49be90-6893-4331-b09c-a68eefc6cbdf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:17.465812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49be90-6893-4331-b09c-a68eefc6cbdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.467184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49be90-6893-4331-b09c-a68eefc6cbdf None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.472875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 485/981] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:17.478634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49be90-6893-4331-b09c-a68eefc6cbdf None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:17.481118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91078767-7b51-4b5e-b154-ed097fdb7677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.482778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91078767-7b51-4b5e-b154-ed097fdb7677 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.483220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91078767-7b51-4b5e-b154-ed097fdb7677 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.483667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91078767-7b51-4b5e-b154-ed097fdb7677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.492409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91078767-7b51-4b5e-b154-ed097fdb7677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.494369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91078767-7b51-4b5e-b154-ed097fdb7677 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-91078767-7b51-4b5e-b154-ed097fdb7677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:13:17.508691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:17.509812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:17.510911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:13:17.510911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:13:17.510911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:13:17.510911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:13:17.510911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:13:17.510911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:13:17.510911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:17.510911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:17.512694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 497/982] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:17.518354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91078767-7b51-4b5e-b154-ed097fdb7677 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:17.531258 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:17.592129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49be90-6893-4331-b09c-a68eefc6cbdf None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.628285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fab0ff-c120-4886-b088-38cf424ad652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.628901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fab0ff-c120-4886-b088-38cf424ad652 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.629182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fab0ff-c120-4886-b088-38cf424ad652 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.629495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fab0ff-c120-4886-b088-38cf424ad652 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.630202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fab0ff-c120-4886-b088-38cf424ad652 None admin] RBAC: Adding query filter params (interface=admin, service_id=be719240f9774e19863bbc5ad350be7c, region_id=RegionOne) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:17.630534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fab0ff-c120-4886-b088-38cf424ad652 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.631880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fab0ff-c120-4886-b088-38cf424ad652 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.635361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91078767-7b51-4b5e-b154-ed097fdb7677 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.637503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 486/983] 10.222.0.61 () {56 vars in 1249 bytes} [Thu Sep 22 18:13:17 2022] GET /identity/v3/endpoints?service_id=be719240f9774e19863bbc5ad350be7c&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:17.642875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fab0ff-c120-4886-b088-38cf424ad652 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:17.687392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dbf20-012e-4ada-92a4-93868fa2271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.688002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dbf20-012e-4ada-92a4-93868fa2271a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.688283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dbf20-012e-4ada-92a4-93868fa2271a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.688553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dbf20-012e-4ada-92a4-93868fa2271a None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.689270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dbf20-012e-4ada-92a4-93868fa2271a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:17.689612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dbf20-012e-4ada-92a4-93868fa2271a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.690975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dbf20-012e-4ada-92a4-93868fa2271a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.703315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 498/984] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:17.709090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dbf20-012e-4ada-92a4-93868fa2271a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:17.744805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:17.751719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fab0ff-c120-4886-b088-38cf424ad652 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.758981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:17.789505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231e4f-7ee6-4e05-ae22-96fa92d3948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.790132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231e4f-7ee6-4e05-ae22-96fa92d3948b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.790420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231e4f-7ee6-4e05-ae22-96fa92d3948b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.790700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231e4f-7ee6-4e05-ae22-96fa92d3948b None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.791313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85231e4f-7ee6-4e05-ae22-96fa92d3948b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.792683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85231e4f-7ee6-4e05-ae22-96fa92d3948b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.798868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 487/985] 10.222.0.61 () {56 vars in 1087 bytes} [Thu Sep 22 18:13:17 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:13:17.818133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dbf20-012e-4ada-92a4-93868fa2271a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:17.857029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fbb82-617d-4f14-87a4-07ee555a3f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:17.857692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fbb82-617d-4f14-87a4-07ee555a3f0c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:17.857971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fbb82-617d-4f14-87a4-07ee555a3f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:17.858244 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fbb82-617d-4f14-87a4-07ee555a3f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:17.859619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fbb82-617d-4f14-87a4-07ee555a3f0c None admin] RBAC: Adding query filter params (role.id=9d1b8b0e878a4d08ab0b856406a139ad, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=99c9b7ef3a7345879747a2193ad8044c) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:17.859934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fbb82-617d-4f14-87a4-07ee555a3f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:17.861432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fbb82-617d-4f14-87a4-07ee555a3f0c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:17.868389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 499/986] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:17 2022] GET /identity/v3/role_assignments?user.id=99c9b7ef3a7345879747a2193ad8044c&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=9d1b8b0e878a4d08ab0b856406a139ad => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:18.568433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787c429-48d2-41bf-87b9-0d81c582fb5a None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:18.568961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787c429-48d2-41bf-87b9-0d81c582fb5a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:18.568961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787c429-48d2-41bf-87b9-0d81c582fb5a None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:18.570529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 488/987] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:18.575632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cbe5c-88e6-45ea-afb8-b355169374ed None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:18.576031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cbe5c-88e6-45ea-afb8-b355169374ed None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:18.576229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cbe5c-88e6-45ea-afb8-b355169374ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:18.595208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-540cbe5c-88e6-45ea-afb8-b355169374ed None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:18.596394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-540cbe5c-88e6-45ea-afb8-b355169374ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:18.677643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 500/988] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:18.949055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787c429-48d2-41bf-87b9-0d81c582fb5a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:19.054334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787c429-48d2-41bf-87b9-0d81c582fb5a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:19.097729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bd30e-a566-48f0-903c-0782249a5f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:19.098355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bd30e-a566-48f0-903c-0782249a5f0e None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:19.098641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bd30e-a566-48f0-903c-0782249a5f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:19.098917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bd30e-a566-48f0-903c-0782249a5f0e None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:19.099588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bd30e-a566-48f0-903c-0782249a5f0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:19.100957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bd30e-a566-48f0-903c-0782249a5f0e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:19.116598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 489/989] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:13:18 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:20.022426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cdd95-287b-4e82-b1d4-9d2084d764fc None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:20.023018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cdd95-287b-4e82-b1d4-9d2084d764fc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:20.023018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cdd95-287b-4e82-b1d4-9d2084d764fc None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:20.025285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 501/990] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:20.030137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79339e59-d64c-4ac3-934a-ea482ef66692 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:20.030681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79339e59-d64c-4ac3-934a-ea482ef66692 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:20.031486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79339e59-d64c-4ac3-934a-ea482ef66692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:20.053953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-79339e59-d64c-4ac3-934a-ea482ef66692 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:20.055171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-79339e59-d64c-4ac3-934a-ea482ef66692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:20.081025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:20.111582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f195e6a-f68b-4af8-8a7c-9f669395a7d4 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:20.111933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f195e6a-f68b-4af8-8a7c-9f669395a7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:20.112122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f195e6a-f68b-4af8-8a7c-9f669395a7d4 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:20.113564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 502/991] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:20.119271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041f633-f6d4-491e-9e16-6ca6e71ac7ae None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:20.119594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041f633-f6d4-491e-9e16-6ca6e71ac7ae None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:20.119830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041f633-f6d4-491e-9e16-6ca6e71ac7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:20.138916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d041f633-f6d4-491e-9e16-6ca6e71ac7ae None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:20.140670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d041f633-f6d4-491e-9e16-6ca6e71ac7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:20.143699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 490/992] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:20.166456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:20.216881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 503/993] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:20.429470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79339e59-d64c-4ac3-934a-ea482ef66692 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:20.487516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041f633-f6d4-491e-9e16-6ca6e71ac7ae None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:20.543908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79339e59-d64c-4ac3-934a-ea482ef66692 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:20.586781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d694baf-05f5-4092-a49c-af495f9899af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:20.587431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694baf-05f5-4092-a49c-af495f9899af None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:20.587713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694baf-05f5-4092-a49c-af495f9899af None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:20.587987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694baf-05f5-4092-a49c-af495f9899af None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:20.588832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d694baf-05f5-4092-a49c-af495f9899af None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:20.590243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d694baf-05f5-4092-a49c-af495f9899af None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-8d694baf-05f5-4092-a49c-af495f9899af None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:20.599559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:20.600768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:20.602600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 491/994] 10.222.0.61 () {56 vars in 1126 bytes} [Thu Sep 22 18:13:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:20.606726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d694baf-05f5-4092-a49c-af495f9899af None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:20.606943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041f633-f6d4-491e-9e16-6ca6e71ac7ae None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:20.630785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:20.646315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a472a-20b5-462e-b6d4-8e0a1dc81db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:20.646962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a472a-20b5-462e-b6d4-8e0a1dc81db5 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:20.647239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a472a-20b5-462e-b6d4-8e0a1dc81db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:20.647499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a472a-20b5-462e-b6d4-8e0a1dc81db5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:20.648442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a472a-20b5-462e-b6d4-8e0a1dc81db5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:20.649468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a472a-20b5-462e-b6d4-8e0a1dc81db5 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-cf6a472a-20b5-462e-b6d4-8e0a1dc81db5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:20.658900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:20.659961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:20.663680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 504/995] 10.222.0.61 () {56 vars in 1105 bytes} [Thu Sep 22 18:13:20 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:20.667613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a472a-20b5-462e-b6d4-8e0a1dc81db5 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:20.699172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:20.727394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d694baf-05f5-4092-a49c-af495f9899af None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:20.764705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3a91-096e-4206-a359-f8ead518e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:20.765403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3a91-096e-4206-a359-f8ead518e978 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:20.765727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3a91-096e-4206-a359-f8ead518e978 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:20.765961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3a91-096e-4206-a359-f8ead518e978 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:20.766610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3a91-096e-4206-a359-f8ead518e978 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:20.766986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3a91-096e-4206-a359-f8ead518e978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:20.768367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3a91-096e-4206-a359-f8ead518e978 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:20.777269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 492/996] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:20.779088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3a91-096e-4206-a359-f8ead518e978 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:20.789944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a472a-20b5-462e-b6d4-8e0a1dc81db5 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:20.829506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a45da-f491-4e8d-a946-5423a9d1ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:20.830628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a45da-f491-4e8d-a946-5423a9d1ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:20.831186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a45da-f491-4e8d-a946-5423a9d1ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:20.831466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a45da-f491-4e8d-a946-5423a9d1ecd2 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:20.843820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a45da-f491-4e8d-a946-5423a9d1ecd2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:20.844119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a45da-f491-4e8d-a946-5423a9d1ecd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:20.845940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a45da-f491-4e8d-a946-5423a9d1ecd2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:20.856682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 505/997] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:20.858247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a45da-f491-4e8d-a946-5423a9d1ecd2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:20.882256 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:20.908967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3a91-096e-4206-a359-f8ead518e978 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:20.949764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef0dd4-d49b-4d5e-b6f5-c10d49d431ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:20.950299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef0dd4-d49b-4d5e-b6f5-c10d49d431ae None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:20.950581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef0dd4-d49b-4d5e-b6f5-c10d49d431ae None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:20.950854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef0dd4-d49b-4d5e-b6f5-c10d49d431ae None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:20.951498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef0dd4-d49b-4d5e-b6f5-c10d49d431ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:20.951810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef0dd4-d49b-4d5e-b6f5-c10d49d431ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:20.953791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef0dd4-d49b-4d5e-b6f5-c10d49d431ae None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:20.958406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:20.959794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 493/998] 10.222.0.61 () {56 vars in 1122 bytes} [Thu Sep 22 18:13:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:20.965979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef0dd4-d49b-4d5e-b6f5-c10d49d431ae None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:20.987094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a45da-f491-4e8d-a946-5423a9d1ecd2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:21.054502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eb3ae-4293-40a5-826e-9e25f34bd377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:21.055588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eb3ae-4293-40a5-826e-9e25f34bd377 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:21.056086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eb3ae-4293-40a5-826e-9e25f34bd377 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:21.056587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eb3ae-4293-40a5-826e-9e25f34bd377 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:21.057804 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eb3ae-4293-40a5-826e-9e25f34bd377 None admin] RBAC: Adding query filter params (type=image) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:21.058375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eb3ae-4293-40a5-826e-9e25f34bd377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:21.060970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eb3ae-4293-40a5-826e-9e25f34bd377 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:21.067258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 506/999] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:21.087419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef0dd4-d49b-4d5e-b6f5-c10d49d431ae None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:21.130604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505b4f7-1a8b-4916-a9af-964e68052b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:21.131282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505b4f7-1a8b-4916-a9af-964e68052b17 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:21.131528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505b4f7-1a8b-4916-a9af-964e68052b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:21.131806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505b4f7-1a8b-4916-a9af-964e68052b17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:21.132511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505b4f7-1a8b-4916-a9af-964e68052b17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:21.133986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505b4f7-1a8b-4916-a9af-964e68052b17 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:21.161276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 494/1000] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:13:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:21.365291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbf35a-6620-4989-a843-bcce352b58b9 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:21.365636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbf35a-6620-4989-a843-bcce352b58b9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:21.365834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbf35a-6620-4989-a843-bcce352b58b9 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:21.367169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 507/1001] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:21.372798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd7f82-53be-4333-96b4-8a1c51e6f9f9 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:21.373095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd7f82-53be-4333-96b4-8a1c51e6f9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:21.373407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd7f82-53be-4333-96b4-8a1c51e6f9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:21.393189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-25bd7f82-53be-4333-96b4-8a1c51e6f9f9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:21.394314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-25bd7f82-53be-4333-96b4-8a1c51e6f9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:21.396701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:21.476094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 495/1002] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:21.747623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbf35a-6620-4989-a843-bcce352b58b9 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:21.926783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbf35a-6620-4989-a843-bcce352b58b9 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:21.995436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f276d-035c-4629-ba39-5e8c2ab64db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:21.996622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f276d-035c-4629-ba39-5e8c2ab64db2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:21.997182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f276d-035c-4629-ba39-5e8c2ab64db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:21.997732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f276d-035c-4629-ba39-5e8c2ab64db2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:21.998892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f276d-035c-4629-ba39-5e8c2ab64db2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:22.002361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f276d-035c-4629-ba39-5e8c2ab64db2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-7d1f276d-035c-4629-ba39-5e8c2ab64db2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:22.021050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:22.022733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 18:13:22.023598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:22.025590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 508/1003] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:22.034355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd7f82-53be-4333-96b4-8a1c51e6f9f9 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:22.201854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd7f82-53be-4333-96b4-8a1c51e6f9f9 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:22.247975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d027eb-0e89-42b5-a5ea-edcaebc665bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:22.248660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d027eb-0e89-42b5-a5ea-edcaebc665bd None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:22.248948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d027eb-0e89-42b5-a5ea-edcaebc665bd None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:22.249226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d027eb-0e89-42b5-a5ea-edcaebc665bd None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:22.249942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d027eb-0e89-42b5-a5ea-edcaebc665bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:22.250248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d027eb-0e89-42b5-a5ea-edcaebc665bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:22.251645 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d027eb-0e89-42b5-a5ea-edcaebc665bd None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:22.253044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:22.261456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 496/1004] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:13:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:22.265580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f276d-035c-4629-ba39-5e8c2ab64db2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:22.283720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:22.384529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f276d-035c-4629-ba39-5e8c2ab64db2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:22.429280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbbfd6-e032-4af7-9e1b-1b435346c4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:22.429917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbbfd6-e032-4af7-9e1b-1b435346c4ef None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:22.430200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbbfd6-e032-4af7-9e1b-1b435346c4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:22.430478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbbfd6-e032-4af7-9e1b-1b435346c4ef None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:22.431115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbbfd6-e032-4af7-9e1b-1b435346c4ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:22.431416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbbfd6-e032-4af7-9e1b-1b435346c4ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:22.432986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbbfd6-e032-4af7-9e1b-1b435346c4ef None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:22.438849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 509/1005] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:13:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:22.444569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d027eb-0e89-42b5-a5ea-edcaebc665bd None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:22.565409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d027eb-0e89-42b5-a5ea-edcaebc665bd None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:22.604983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f640-db0a-46da-9126-2d04aeec0177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:22.605402 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f640-db0a-46da-9126-2d04aeec0177 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:22.605688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f640-db0a-46da-9126-2d04aeec0177 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:22.605962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f640-db0a-46da-9126-2d04aeec0177 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:22.606676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683f640-db0a-46da-9126-2d04aeec0177 None admin] RBAC: Adding query filter params (interface=public, service_id=a725d8a74a5f476c80c05da6b22ced42, region_id=RegionOne) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:22.606989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683f640-db0a-46da-9126-2d04aeec0177 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:22.608391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683f640-db0a-46da-9126-2d04aeec0177 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:22.615416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 497/1006] 10.222.0.61 () {56 vars in 1251 bytes} [Thu Sep 22 18:13:22 2022] GET /identity/v3/endpoints?service_id=a725d8a74a5f476c80c05da6b22ced42&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:22.621608 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbbfd6-e032-4af7-9e1b-1b435346c4ef None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:22.735864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:22.765368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbbfd6-e032-4af7-9e1b-1b435346c4ef None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:22.804776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e65354-f719-4650-912d-e79031d7a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:22.805446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e65354-f719-4650-912d-e79031d7a28e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:22.805730 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e65354-f719-4650-912d-e79031d7a28e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:22.806006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e65354-f719-4650-912d-e79031d7a28e None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:22.806622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e65354-f719-4650-912d-e79031d7a28e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:22.808019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e65354-f719-4650-912d-e79031d7a28e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:22.815094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 510/1007] 10.222.0.61 () {56 vars in 1087 bytes} [Thu Sep 22 18:13:22 2022] GET /identity/v3/services => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:13:23.325855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10385cf6-0ab1-4d1f-8092-de507e9831a0 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:23.326437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10385cf6-0ab1-4d1f-8092-de507e9831a0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:23.326437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10385cf6-0ab1-4d1f-8092-de507e9831a0 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:23.328397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 498/1008] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:23.334766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3c7a-c3f8-49fc-a2ae-d65fc1b38868 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:23.335293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3c7a-c3f8-49fc-a2ae-d65fc1b38868 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:23.335293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3c7a-c3f8-49fc-a2ae-d65fc1b38868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:23.363048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-549f3c7a-c3f8-49fc-a2ae-d65fc1b38868 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:23.364236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-549f3c7a-c3f8-49fc-a2ae-d65fc1b38868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:23.441300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 511/1009] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:23.444365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafc494-83c8-4817-93c7-a7220e41fe1c None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:23.444660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafc494-83c8-4817-93c7-a7220e41fe1c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:23.444943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafc494-83c8-4817-93c7-a7220e41fe1c None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:23.446689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 499/1010] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:23.451942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13188b0-c7e1-4810-8de1-a21b5ce4b858 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:23.452229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13188b0-c7e1-4810-8de1-a21b5ce4b858 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:23.452507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13188b0-c7e1-4810-8de1-a21b5ce4b858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:23.472362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d13188b0-c7e1-4810-8de1-a21b5ce4b858 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:23.473598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d13188b0-c7e1-4810-8de1-a21b5ce4b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:23.548671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 512/1011] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:23.709139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafc494-83c8-4817-93c7-a7220e41fe1c None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:23.776029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:23.812031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13188b0-c7e1-4810-8de1-a21b5ce4b858 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:23.814269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:23.820045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafc494-83c8-4817-93c7-a7220e41fe1c None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:23.860599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3940cf-c9a4-4f02-af45-d39705ee2831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:23.861753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3940cf-c9a4-4f02-af45-d39705ee2831 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:23.862039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3940cf-c9a4-4f02-af45-d39705ee2831 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:23.862311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3940cf-c9a4-4f02-af45-d39705ee2831 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:23.863281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3940cf-c9a4-4f02-af45-d39705ee2831 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:23.864810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3940cf-c9a4-4f02-af45-d39705ee2831 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:23.889854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 500/1012] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:13:23 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:23.932445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13188b0-c7e1-4810-8de1-a21b5ce4b858 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:23.980712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ca44-1688-4ac2-ac99-014c8d2be73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:23.981428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ca44-1688-4ac2-ac99-014c8d2be73a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:23.981712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ca44-1688-4ac2-ac99-014c8d2be73a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:23.981986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ca44-1688-4ac2-ac99-014c8d2be73a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:23.983260 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945ca44-1688-4ac2-ac99-014c8d2be73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:23.985982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945ca44-1688-4ac2-ac99-014c8d2be73a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:23.989325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 513/1013] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:23.995701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3940cf-c9a4-4f02-af45-d39705ee2831 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:24.117452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3940cf-c9a4-4f02-af45-d39705ee2831 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:24.142710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:24.156909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bbe74-5250-4590-a995-7e17972abf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:24.157565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bbe74-5250-4590-a995-7e17972abf64 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:24.158989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bbe74-5250-4590-a995-7e17972abf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:24.158989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bbe74-5250-4590-a995-7e17972abf64 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:24.158989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bbe74-5250-4590-a995-7e17972abf64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:24.160218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bbe74-5250-4590-a995-7e17972abf64 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:24.196663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 501/1014] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:13:23 2022] POST /identity/v3/projects => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:13:25.068919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf5eba-dbf4-4571-be97-7b114921d05c None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:25.069490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf5eba-dbf4-4571-be97-7b114921d05c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:25.069490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf5eba-dbf4-4571-be97-7b114921d05c None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:25.071003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 514/1015] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:25.076657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a46c9-1770-4300-9b81-5d595be0054d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:25.077201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a46c9-1770-4300-9b81-5d595be0054d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:25.077201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a46c9-1770-4300-9b81-5d595be0054d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:25.097909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-960a46c9-1770-4300-9b81-5d595be0054d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:25.099310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-960a46c9-1770-4300-9b81-5d595be0054d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:25.177638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 502/1016] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:25 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:25.442879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf5eba-dbf4-4571-be97-7b114921d05c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:25.524519 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:25.572913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf5eba-dbf4-4571-be97-7b114921d05c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:25.610349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6a450-3e8f-40a3-a6ea-7c47237709d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:25.611294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a450-3e8f-40a3-a6ea-7c47237709d3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:25.611729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a450-3e8f-40a3-a6ea-7c47237709d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:25.612154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a450-3e8f-40a3-a6ea-7c47237709d3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:25.612908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a450-3e8f-40a3-a6ea-7c47237709d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:25.614477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a450-3e8f-40a3-a6ea-7c47237709d3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-3bc6a450-3e8f-40a3-a6ea-7c47237709d3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:25.624335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:25.626014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 18:13:25.626867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:25.627621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 515/1017] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:25.632747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a46c9-1770-4300-9b81-5d595be0054d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:25.754475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a46c9-1770-4300-9b81-5d595be0054d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:25.757037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:25.797275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07606694-d39a-411a-bb99-0ab7e89c05a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:25.797890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07606694-d39a-411a-bb99-0ab7e89c05a4 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:25.798166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07606694-d39a-411a-bb99-0ab7e89c05a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:25.798437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07606694-d39a-411a-bb99-0ab7e89c05a4 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:25.799133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07606694-d39a-411a-bb99-0ab7e89c05a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:25.799437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07606694-d39a-411a-bb99-0ab7e89c05a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:25.800805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07606694-d39a-411a-bb99-0ab7e89c05a4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:25.806669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 503/1018] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:13:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:25.812926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6a450-3e8f-40a3-a6ea-7c47237709d3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:25.981020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6a450-3e8f-40a3-a6ea-7c47237709d3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:26.025372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:26.053271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129226a-d8a4-4481-9107-c806daf75a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:26.053271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129226a-d8a4-4481-9107-c806daf75a4a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:26.053271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129226a-d8a4-4481-9107-c806daf75a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:26.053271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129226a-d8a4-4481-9107-c806daf75a4a None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:26.053701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129226a-d8a4-4481-9107-c806daf75a4a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:26.053701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129226a-d8a4-4481-9107-c806daf75a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:26.061276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129226a-d8a4-4481-9107-c806daf75a4a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:26.066602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 516/1019] 10.222.0.61 () {56 vars in 1112 bytes} [Thu Sep 22 18:13:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:26.073276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07606694-d39a-411a-bb99-0ab7e89c05a4 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:26.157755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c6d1-fd74-450e-9bbe-af263edbe2db None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:26.158300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c6d1-fd74-450e-9bbe-af263edbe2db None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:26.158300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c6d1-fd74-450e-9bbe-af263edbe2db None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:26.161597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 517/1020] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:26.164899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b31e68-a12f-4e6f-8c83-f35053650330 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:26.165197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b31e68-a12f-4e6f-8c83-f35053650330 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:26.165532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b31e68-a12f-4e6f-8c83-f35053650330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:26.185391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-e1b31e68-a12f-4e6f-8c83-f35053650330 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:26.186614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e1b31e68-a12f-4e6f-8c83-f35053650330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:26.204997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07606694-d39a-411a-bb99-0ab7e89c05a4 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:26.246627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e68a5-a624-4997-91d1-fff79b8025a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:26.247369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e68a5-a624-4997-91d1-fff79b8025a0 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:26.247543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e68a5-a624-4997-91d1-fff79b8025a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:26.247822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e68a5-a624-4997-91d1-fff79b8025a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:26.248880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e68a5-a624-4997-91d1-fff79b8025a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:26.249968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e68a5-a624-4997-91d1-fff79b8025a0 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:26.275009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 518/1021] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:26 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:26.284806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 504/1022] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:13:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:26.466285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1be5c6-3395-4be3-b317-70c722a8cdef None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:26.466614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1be5c6-3395-4be3-b317-70c722a8cdef None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:26.466824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1be5c6-3395-4be3-b317-70c722a8cdef None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:26.469043 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 519/1023] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:26.474863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd7a82-03bf-477a-90bc-07b52510e3f1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:26.475154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd7a82-03bf-477a-90bc-07b52510e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:26.475429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd7a82-03bf-477a-90bc-07b52510e3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:26.495768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-10dd7a82-03bf-477a-90bc-07b52510e3f1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:26.497007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-10dd7a82-03bf-477a-90bc-07b52510e3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:26.518361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:26.554156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1be5c6-3395-4be3-b317-70c722a8cdef None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:26.616436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 505/1024] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:26.689181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1be5c6-3395-4be3-b317-70c722a8cdef None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:26.719655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:26.731470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392b225-c171-4158-bec3-b81a9aace567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:26.732114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392b225-c171-4158-bec3-b81a9aace567 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:26.732392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392b225-c171-4158-bec3-b81a9aace567 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:26.732663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392b225-c171-4158-bec3-b81a9aace567 None admin] PATH_INFO: `/v3/services/image` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:26.733272 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392b225-c171-4158-bec3-b81a9aace567 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:26.734686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392b225-c171-4158-bec3-b81a9aace567 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-b392b225-c171-4158-bec3-b81a9aace567 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:26.750696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:26.752056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:26.753052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 520/1025] 10.222.0.61 () {56 vars in 1105 bytes} [Thu Sep 22 18:13:26 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:26.757774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd7a82-03bf-477a-90bc-07b52510e3f1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:26.862784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd7a82-03bf-477a-90bc-07b52510e3f1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:26.897772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392b225-c171-4158-bec3-b81a9aace567 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:26.909059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a41f4c-be84-4016-a578-9e375e9e511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:26.909724 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41f4c-be84-4016-a578-9e375e9e511c None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:26.910009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41f4c-be84-4016-a578-9e375e9e511c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:26.910280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41f4c-be84-4016-a578-9e375e9e511c None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:26.911457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41f4c-be84-4016-a578-9e375e9e511c None admin] RBAC: Adding query filter params (name=image) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:26.911701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41f4c-be84-4016-a578-9e375e9e511c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:26.913411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41f4c-be84-4016-a578-9e375e9e511c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:26.918989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 506/1026] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:26.924561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a41f4c-be84-4016-a578-9e375e9e511c None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:26.942266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:27.028752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392b225-c171-4158-bec3-b81a9aace567 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:27.046981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a41f4c-be84-4016-a578-9e375e9e511c None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:27.068644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c40b19-995b-4c04-8100-2fc64f63d48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:27.069618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c40b19-995b-4c04-8100-2fc64f63d48a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:27.070061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c40b19-995b-4c04-8100-2fc64f63d48a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:27.070490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c40b19-995b-4c04-8100-2fc64f63d48a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:27.071965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c40b19-995b-4c04-8100-2fc64f63d48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:27.073462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c40b19-995b-4c04-8100-2fc64f63d48a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:27.077291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 521/1027] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:27.081862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c40b19-995b-4c04-8100-2fc64f63d48a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:27.091500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddbcb2-4458-4c90-be99-1136c88b62f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:27.092428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddbcb2-4458-4c90-be99-1136c88b62f5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:27.092930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddbcb2-4458-4c90-be99-1136c88b62f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:27.093345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddbcb2-4458-4c90-be99-1136c88b62f5 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:27.094838 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddbcb2-4458-4c90-be99-1136c88b62f5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:27.095154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddbcb2-4458-4c90-be99-1136c88b62f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:27.096742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddbcb2-4458-4c90-be99-1136c88b62f5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:27.105441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 507/1028] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:27.109164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddbcb2-4458-4c90-be99-1136c88b62f5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:27.158939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:27.215336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c40b19-995b-4c04-8100-2fc64f63d48a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:27.222350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:27.252701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddbcb2-4458-4c90-be99-1136c88b62f5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:27.272446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbd94a-3771-4c77-b070-553e8b1ce90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:27.273068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbd94a-3771-4c77-b070-553e8b1ce90e None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:27.273385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbd94a-3771-4c77-b070-553e8b1ce90e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:27.273661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbd94a-3771-4c77-b070-553e8b1ce90e None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:27.274323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbd94a-3771-4c77-b070-553e8b1ce90e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:27.275762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbd94a-3771-4c77-b070-553e8b1ce90e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:27.309269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 522/1029] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:13:27 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:13:27.318060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d2237-def6-44c6-8589-ce957c8a0b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:27.318707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d2237-def6-44c6-8589-ce957c8a0b1a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:27.318984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d2237-def6-44c6-8589-ce957c8a0b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:27.319255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d2237-def6-44c6-8589-ce957c8a0b1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:27.320006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d2237-def6-44c6-8589-ce957c8a0b1a None admin] RBAC: Adding query filter params (interface=public, service_id=d78e6bbf866b4874bbaf2b34bd8df91f, region_id=RegionOne) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:27.320315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d2237-def6-44c6-8589-ce957c8a0b1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:27.321810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d2237-def6-44c6-8589-ce957c8a0b1a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:27.328033 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 508/1030] 10.222.0.61 () {56 vars in 1251 bytes} [Thu Sep 22 18:13:27 2022] GET /identity/v3/endpoints?service_id=d78e6bbf866b4874bbaf2b34bd8df91f&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:27.334333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbd94a-3771-4c77-b070-553e8b1ce90e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:27.455683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbd94a-3771-4c77-b070-553e8b1ce90e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:27.471420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:27.501152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6ef2-6b7c-4672-9e4d-86e6fd5e6a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:27.502039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6ef2-6b7c-4672-9e4d-86e6fd5e6a0d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:27.502226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6ef2-6b7c-4672-9e4d-86e6fd5e6a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:27.502488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6ef2-6b7c-4672-9e4d-86e6fd5e6a0d None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:27.503137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6ef2-6b7c-4672-9e4d-86e6fd5e6a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:27.504584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6ef2-6b7c-4672-9e4d-86e6fd5e6a0d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:27.517070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 523/1031] 10.222.0.61 () {56 vars in 1087 bytes} [Thu Sep 22 18:13:27 2022] GET /identity/v3/services => generated 1957 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:13:28.611620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca55a-b478-46eb-bde3-750f661c75cf None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:28.614048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca55a-b478-46eb-bde3-750f661c75cf None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:28.614048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca55a-b478-46eb-bde3-750f661c75cf None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:28.614048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 509/1032] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:28.619603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d243a-9950-49a2-a18a-fee03a59485e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:28.620079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d243a-9950-49a2-a18a-fee03a59485e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:28.620164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d243a-9950-49a2-a18a-fee03a59485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:28.639620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-0a1d243a-9950-49a2-a18a-fee03a59485e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:28.640809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-0a1d243a-9950-49a2-a18a-fee03a59485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:28.733037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 524/1033] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:28.998404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dca55a-b478-46eb-bde3-750f661c75cf None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:29.110603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dca55a-b478-46eb-bde3-750f661c75cf None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:29.153941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22249df-0a7d-4a26-851d-caaff1e33d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:29.154587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22249df-0a7d-4a26-851d-caaff1e33d7e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:29.154865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22249df-0a7d-4a26-851d-caaff1e33d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:29.155136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22249df-0a7d-4a26-851d-caaff1e33d7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:29.166643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22249df-0a7d-4a26-851d-caaff1e33d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-d22249df-0a7d-4a26-851d-caaff1e33d7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:29.171687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:29.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:29.174211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:29.177697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 510/1034] 10.222.0.61 () {56 vars in 1120 bytes} [Thu Sep 22 18:13:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:29.178806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d243a-9950-49a2-a18a-fee03a59485e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:29.287490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d243a-9950-49a2-a18a-fee03a59485e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:29.296194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:29.326484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fc605-40cd-42e2-8a30-ced0cc70d075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:29.327119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fc605-40cd-42e2-8a30-ced0cc70d075 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:29.327402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fc605-40cd-42e2-8a30-ced0cc70d075 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:29.328194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fc605-40cd-42e2-8a30-ced0cc70d075 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:29.328877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fc605-40cd-42e2-8a30-ced0cc70d075 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:29.329183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fc605-40cd-42e2-8a30-ced0cc70d075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:29.330605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fc605-40cd-42e2-8a30-ced0cc70d075 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:29.345023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 525/1035] 10.222.0.61 () {56 vars in 1115 bytes} [Thu Sep 22 18:13:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:29.347347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22249df-0a7d-4a26-851d-caaff1e33d7e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:29.350367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:29.455259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22249df-0a7d-4a26-851d-caaff1e33d7e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:29.496088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506fe2-bcfe-49a2-b7a2-d6618eb2c7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:29.496899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506fe2-bcfe-49a2-b7a2-d6618eb2c7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:29.497346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506fe2-bcfe-49a2-b7a2-d6618eb2c7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:29.497750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506fe2-bcfe-49a2-b7a2-d6618eb2c7c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:29.509519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506fe2-bcfe-49a2-b7a2-d6618eb2c7c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:29.510998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506fe2-bcfe-49a2-b7a2-d6618eb2c7c2 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ed506fe2-bcfe-49a2-b7a2-d6618eb2c7c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:29.528367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:29.534854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:29.536063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:29.536063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:29.536063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:29.536063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 511/1036] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:29.537927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fc605-40cd-42e2-8a30-ced0cc70d075 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:29.640868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955729-e6b6-442f-97fb-d7b588b67941 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:29.641461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955729-e6b6-442f-97fb-d7b588b67941 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:29.641461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955729-e6b6-442f-97fb-d7b588b67941 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:29.643175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 512/1037] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:29.648824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18803f9-3ee8-4666-9cde-8fa98ec76f6d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:29.649464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18803f9-3ee8-4666-9cde-8fa98ec76f6d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:29.649890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fc605-40cd-42e2-8a30-ced0cc70d075 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:29.650473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18803f9-3ee8-4666-9cde-8fa98ec76f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:29.679847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-c18803f9-3ee8-4666-9cde-8fa98ec76f6d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:29.681063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c18803f9-3ee8-4666-9cde-8fa98ec76f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:29.691076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec436d9-e8f4-482a-b4ae-785df6b8f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:29.691710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec436d9-e8f4-482a-b4ae-785df6b8f7fc None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:29.691990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec436d9-e8f4-482a-b4ae-785df6b8f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:29.692499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec436d9-e8f4-482a-b4ae-785df6b8f7fc None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:29.692941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec436d9-e8f4-482a-b4ae-785df6b8f7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:29.693401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec436d9-e8f4-482a-b4ae-785df6b8f7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:29.694757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec436d9-e8f4-482a-b4ae-785df6b8f7fc None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:29.709309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 526/1038] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:29.715173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec436d9-e8f4-482a-b4ae-785df6b8f7fc None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:29.746093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:29.748419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:29.766857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 513/1039] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:29.768459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59516f0-e91b-4b69-901a-c13491ecdf4d None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:29.768829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59516f0-e91b-4b69-901a-c13491ecdf4d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:29.769012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59516f0-e91b-4b69-901a-c13491ecdf4d None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:29.770497 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 514/1040] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:29.775696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2bd3e-d5a4-4709-8c41-66c41bbb1006 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:29.776123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2bd3e-d5a4-4709-8c41-66c41bbb1006 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:29.776295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2bd3e-d5a4-4709-8c41-66c41bbb1006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:29.794581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-aed2bd3e-d5a4-4709-8c41-66c41bbb1006 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:29.795691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-aed2bd3e-d5a4-4709-8c41-66c41bbb1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:29.827726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec436d9-e8f4-482a-b4ae-785df6b8f7fc None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:29.866788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646543-1dfd-4f6f-9424-d49b8300a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:29.867435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646543-1dfd-4f6f-9424-d49b8300a679 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:29.867719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646543-1dfd-4f6f-9424-d49b8300a679 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:29.869327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646543-1dfd-4f6f-9424-d49b8300a679 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:29.869449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 515/1041] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:29.883094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0646543-1dfd-4f6f-9424-d49b8300a679 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:29.884541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0646543-1dfd-4f6f-9424-d49b8300a679 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-c0646543-1dfd-4f6f-9424-d49b8300a679 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:13:29.896693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:29.897965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:29.898966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 527/1042] 10.222.0.61 () {56 vars in 1093 bytes} [Thu Sep 22 18:13:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:29.905934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2bd3e-d5a4-4709-8c41-66c41bbb1006 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.016062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2bd3e-d5a4-4709-8c41-66c41bbb1006 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.030026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:30.038666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646543-1dfd-4f6f-9424-d49b8300a679 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.056457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a9452-75c8-4841-936e-51106d6302a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.057336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a9452-75c8-4841-936e-51106d6302a5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.057784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a9452-75c8-4841-936e-51106d6302a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.058216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a9452-75c8-4841-936e-51106d6302a5 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.059120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a9452-75c8-4841-936e-51106d6302a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:30.059598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a9452-75c8-4841-936e-51106d6302a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:30.061158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a9452-75c8-4841-936e-51106d6302a5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:30.081687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 516/1043] 10.222.0.61 () {56 vars in 1133 bytes} [Thu Sep 22 18:13:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:30.086771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a9452-75c8-4841-936e-51106d6302a5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.134854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:30.147464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646543-1dfd-4f6f-9424-d49b8300a679 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.183087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88cbd-2943-4bb1-9e48-145c496540a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.183744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88cbd-2943-4bb1-9e48-145c496540a5 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.184023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88cbd-2943-4bb1-9e48-145c496540a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.184295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88cbd-2943-4bb1-9e48-145c496540a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.196781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a9452-75c8-4841-936e-51106d6302a5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.197029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b88cbd-2943-4bb1-9e48-145c496540a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-b7b88cbd-2943-4bb1-9e48-145c496540a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:30.201964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:30.203241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:13:30.204265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:30.208363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 528/1044] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:30.209334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88cbd-2943-4bb1-9e48-145c496540a5 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.238330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cab8a-2100-4393-8f39-d3c3b4f2c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.239069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cab8a-2100-4393-8f39-d3c3b4f2c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.239357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cab8a-2100-4393-8f39-d3c3b4f2c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.239624 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cab8a-2100-4393-8f39-d3c3b4f2c5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.285496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:30.313793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cab8a-2100-4393-8f39-d3c3b4f2c5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:30.315197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cab8a-2100-4393-8f39-d3c3b4f2c5d5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:30.317122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88cbd-2943-4bb1-9e48-145c496540a5 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.351509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f07f3-fd57-4142-a08e-7b4c7c93eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.352148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f07f3-fd57-4142-a08e-7b4c7c93eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.352431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f07f3-fd57-4142-a08e-7b4c7c93eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.352703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f07f3-fd57-4142-a08e-7b4c7c93eaf5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.353315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f07f3-fd57-4142-a08e-7b4c7c93eaf5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:30.354687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f07f3-fd57-4142-a08e-7b4c7c93eaf5 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-455f07f3-fd57-4142-a08e-7b4c7c93eaf5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:30.364268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:30.365754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:30.366787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 529/1045] 10.222.0.61 () {56 vars in 1105 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:30.367777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f07f3-fd57-4142-a08e-7b4c7c93eaf5 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.383522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:30.426380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 517/1046] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 18:13:30.427240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cab8a-2100-4393-8f39-d3c3b4f2c5d5 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.483952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f07f3-fd57-4142-a08e-7b4c7c93eaf5 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.503689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:30.527924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef414a0-b9ba-4a8d-824d-11b1fb0faa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.528765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef414a0-b9ba-4a8d-824d-11b1fb0faa5e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.529047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef414a0-b9ba-4a8d-824d-11b1fb0faa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.529355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef414a0-b9ba-4a8d-824d-11b1fb0faa5e None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.530050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef414a0-b9ba-4a8d-824d-11b1fb0faa5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:30.530357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef414a0-b9ba-4a8d-824d-11b1fb0faa5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:30.532279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef414a0-b9ba-4a8d-824d-11b1fb0faa5e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:30.535424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cab8a-2100-4393-8f39-d3c3b4f2c5d5 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.541459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 530/1047] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:30.542453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef414a0-b9ba-4a8d-824d-11b1fb0faa5e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.578376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2c45a-90c2-4e2f-9cf5-1ab112b23322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.578950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2c45a-90c2-4e2f-9cf5-1ab112b23322 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.579411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2c45a-90c2-4e2f-9cf5-1ab112b23322 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.579694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2c45a-90c2-4e2f-9cf5-1ab112b23322 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.580517 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2c45a-90c2-4e2f-9cf5-1ab112b23322 None admin] RBAC: Adding query filter params (name=image) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:30.580821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2c45a-90c2-4e2f-9cf5-1ab112b23322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:30.582246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2c45a-90c2-4e2f-9cf5-1ab112b23322 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:30.587564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 518/1048] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:30.588393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2c45a-90c2-4e2f-9cf5-1ab112b23322 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.631011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:30.661912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef414a0-b9ba-4a8d-824d-11b1fb0faa5e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.700621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed3164-999f-4cc1-9734-e382e7a19c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.701589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed3164-999f-4cc1-9734-e382e7a19c90 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.702087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed3164-999f-4cc1-9734-e382e7a19c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.702567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed3164-999f-4cc1-9734-e382e7a19c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.715150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2c45a-90c2-4e2f-9cf5-1ab112b23322 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.719972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed3164-999f-4cc1-9734-e382e7a19c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:30.721471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed3164-999f-4cc1-9734-e382e7a19c90 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-f2ed3164-999f-4cc1-9734-e382e7a19c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:30.736837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:30.737897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:30.738878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:30.738878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:30.738878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:30.738878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 531/1049] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:30.738878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed3164-999f-4cc1-9734-e382e7a19c90 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.756924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52558251-36bc-414e-ae1a-7cb6548b5b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.757607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52558251-36bc-414e-ae1a-7cb6548b5b0d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.757891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52558251-36bc-414e-ae1a-7cb6548b5b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.758169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52558251-36bc-414e-ae1a-7cb6548b5b0d None admin] PATH_INFO: `/v3/users/4cfa3912876b44098d185c41f9b28c05` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.760924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:30.773269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52558251-36bc-414e-ae1a-7cb6548b5b0d None admin] RBAC: Authorizing `identity:get_user(user_id=4cfa3912876b44098d185c41f9b28c05)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:30.774747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52558251-36bc-414e-ae1a-7cb6548b5b0d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:30.776436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 519/1050] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/users/4cfa3912876b44098d185c41f9b28c05 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:30.777211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52558251-36bc-414e-ae1a-7cb6548b5b0d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.847473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed3164-999f-4cc1-9734-e382e7a19c90 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.873521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:30.883759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf42f3-47d6-4219-9d8d-74d5f771d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.884373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf42f3-47d6-4219-9d8d-74d5f771d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.884655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf42f3-47d6-4219-9d8d-74d5f771d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.884926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf42f3-47d6-4219-9d8d-74d5f771d0e7 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.885594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf42f3-47d6-4219-9d8d-74d5f771d0e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:30.885895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf42f3-47d6-4219-9d8d-74d5f771d0e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:30.887264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf42f3-47d6-4219-9d8d-74d5f771d0e7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:30.888128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52558251-36bc-414e-ae1a-7cb6548b5b0d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:30.892779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 532/1051] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:30.893645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf42f3-47d6-4219-9d8d-74d5f771d0e7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.924960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c4e97-aa86-4381-8450-be64a11faa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:30.925608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c4e97-aa86-4381-8450-be64a11faa3b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:30.925891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c4e97-aa86-4381-8450-be64a11faa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:30.926166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c4e97-aa86-4381-8450-be64a11faa3b None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:30.926817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c4e97-aa86-4381-8450-be64a11faa3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:30.927120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c4e97-aa86-4381-8450-be64a11faa3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:30.928495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c4e97-aa86-4381-8450-be64a11faa3b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:30.939993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 520/1052] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:30.940806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c4e97-aa86-4381-8450-be64a11faa3b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:30.998464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:30.999389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf42f3-47d6-4219-9d8d-74d5f771d0e7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:31.034991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823efd2-f267-425e-a2da-c1a9d9da1372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:31.035611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823efd2-f267-425e-a2da-c1a9d9da1372 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:31.035894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823efd2-f267-425e-a2da-c1a9d9da1372 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:31.036225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823efd2-f267-425e-a2da-c1a9d9da1372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:31.046709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c4e97-aa86-4381-8450-be64a11faa3b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:31.083446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9ea24-7211-4de6-abc7-b153e95ff5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:31.084069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9ea24-7211-4de6-abc7-b153e95ff5bd None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:31.084354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9ea24-7211-4de6-abc7-b153e95ff5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:31.084630 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9ea24-7211-4de6-abc7-b153e95ff5bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:31.085326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9ea24-7211-4de6-abc7-b153e95ff5bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:31.086714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9ea24-7211-4de6-abc7-b153e95ff5bd None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:31.097262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:31.107912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 521/1053] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:13:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:31.108977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823efd2-f267-425e-a2da-c1a9d9da1372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:31.109132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9ea24-7211-4de6-abc7-b153e95ff5bd None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:31.110537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823efd2-f267-425e-a2da-c1a9d9da1372 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:31.244544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 533/1054] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:13:31.245901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823efd2-f267-425e-a2da-c1a9d9da1372 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:31.252343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9ea24-7211-4de6-abc7-b153e95ff5bd None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:31.261671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:31.300246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb0b59-8439-4cd2-a689-5faf48598b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:31.300883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb0b59-8439-4cd2-a689-5faf48598b83 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:31.301169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb0b59-8439-4cd2-a689-5faf48598b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:31.301593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb0b59-8439-4cd2-a689-5faf48598b83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:31.309043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb0b59-8439-4cd2-a689-5faf48598b83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:31.310546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb0b59-8439-4cd2-a689-5faf48598b83 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-9abb0b59-8439-4cd2-a689-5faf48598b83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:13:31.323247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:31.324368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:31.325363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:13:31.325363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:13:31.325363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:13:31.325363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:13:31.325363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:13:31.325363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:13:31.325363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:31.325363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:31.325363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 522/1055] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:31.331256 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb0b59-8439-4cd2-a689-5faf48598b83 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:31.361037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:31.374501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823efd2-f267-425e-a2da-c1a9d9da1372 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:31.421995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e007d7-e212-4a43-9cc9-eaceb1bfe992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:31.422648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e007d7-e212-4a43-9cc9-eaceb1bfe992 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:31.422943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e007d7-e212-4a43-9cc9-eaceb1bfe992 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:31.423195 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e007d7-e212-4a43-9cc9-eaceb1bfe992 None admin] PATH_INFO: `/v3/projects/2a13ddd802804e1bbfbbd65a5047b547` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:31.424338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e007d7-e212-4a43-9cc9-eaceb1bfe992 None admin] RBAC: Authorizing `identity:get_project(project_id=2a13ddd802804e1bbfbbd65a5047b547)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:31.425816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e007d7-e212-4a43-9cc9-eaceb1bfe992 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:31.427497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 534/1056] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:13:31 2022] GET /identity/v3/projects/2a13ddd802804e1bbfbbd65a5047b547 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:31.433486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e007d7-e212-4a43-9cc9-eaceb1bfe992 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:31.445815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb0b59-8439-4cd2-a689-5faf48598b83 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:31.483233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742109b-baea-4e24-9a66-6f5c9cddb6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:31.484436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742109b-baea-4e24-9a66-6f5c9cddb6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:31.484720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742109b-baea-4e24-9a66-6f5c9cddb6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:31.484990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742109b-baea-4e24-9a66-6f5c9cddb6e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:31.485734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742109b-baea-4e24-9a66-6f5c9cddb6e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:31.486045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742109b-baea-4e24-9a66-6f5c9cddb6e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:31.487489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742109b-baea-4e24-9a66-6f5c9cddb6e2 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:31.502310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 523/1057] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:13:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:31.508785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742109b-baea-4e24-9a66-6f5c9cddb6e2 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:31.547852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:31.570430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e007d7-e212-4a43-9cc9-eaceb1bfe992 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:31.607984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692787ac-f41c-44e6-8ee9-a6d678ef6c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:31.608612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692787ac-f41c-44e6-8ee9-a6d678ef6c3f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:31.608898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692787ac-f41c-44e6-8ee9-a6d678ef6c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:31.609713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692787ac-f41c-44e6-8ee9-a6d678ef6c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:31.610461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692787ac-f41c-44e6-8ee9-a6d678ef6c3f None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=2a13ddd802804e1bbfbbd65a5047b547, user.id=4cfa3912876b44098d185c41f9b28c05) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:31.610775 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692787ac-f41c-44e6-8ee9-a6d678ef6c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:31.612289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692787ac-f41c-44e6-8ee9-a6d678ef6c3f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:31.618118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 535/1058] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:31 2022] GET /identity/v3/role_assignments?user.id=4cfa3912876b44098d185c41f9b28c05&scope.project.id=2a13ddd802804e1bbfbbd65a5047b547&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:31.640927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742109b-baea-4e24-9a66-6f5c9cddb6e2 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:31.700933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19c2aa-c1a7-476c-9694-8fefdc5f4a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:31.701606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19c2aa-c1a7-476c-9694-8fefdc5f4a18 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:31.701881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19c2aa-c1a7-476c-9694-8fefdc5f4a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:31.702150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19c2aa-c1a7-476c-9694-8fefdc5f4a18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:31.702956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19c2aa-c1a7-476c-9694-8fefdc5f4a18 None admin] RBAC: Adding query filter params (role.id=9d1b8b0e878a4d08ab0b856406a139ad, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=d710bb85a200419aa071e119976115c6) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:31.703259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19c2aa-c1a7-476c-9694-8fefdc5f4a18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:31.704747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19c2aa-c1a7-476c-9694-8fefdc5f4a18 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:31.717547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 524/1059] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:31 2022] GET /identity/v3/role_assignments?user.id=d710bb85a200419aa071e119976115c6&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=9d1b8b0e878a4d08ab0b856406a139ad => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:33.367851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265e1b2-ab31-40e4-8f84-15d6bce45753 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:33.368688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265e1b2-ab31-40e4-8f84-15d6bce45753 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:33.368688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265e1b2-ab31-40e4-8f84-15d6bce45753 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:33.370256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 536/1060] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:33.379472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676f04-a9be-45af-87a7-72d1aed99dc1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:33.380977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676f04-a9be-45af-87a7-72d1aed99dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:33.380977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676f04-a9be-45af-87a7-72d1aed99dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:33.405031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2d676f04-a9be-45af-87a7-72d1aed99dc1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:33.406797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2d676f04-a9be-45af-87a7-72d1aed99dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:33.486414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 525/1061] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:33.753101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265e1b2-ab31-40e4-8f84-15d6bce45753 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:33.780472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:33.881455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265e1b2-ab31-40e4-8f84-15d6bce45753 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:33.920687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89f72c-254a-4f81-929e-5bbd92a3ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:33.922208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f72c-254a-4f81-929e-5bbd92a3ea7b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:33.922645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f72c-254a-4f81-929e-5bbd92a3ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:33.923072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f72c-254a-4f81-929e-5bbd92a3ea7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:33.955888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d82d-ed3e-44e3-971b-2a8a75a0a480 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:33.956113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d82d-ed3e-44e3-971b-2a8a75a0a480 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:33.956334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d82d-ed3e-44e3-971b-2a8a75a0a480 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:33.957975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 526/1062] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:33.963517 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ca7c-3d7b-4422-be19-4582484dd857 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:33.963836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ca7c-3d7b-4422-be19-4582484dd857 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:33.964347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ca7c-3d7b-4422-be19-4582484dd857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:33.983507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8b20ca7c-3d7b-4422-be19-4582484dd857 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:33.984779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8b20ca7c-3d7b-4422-be19-4582484dd857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:34.001999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:34.056796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89f72c-254a-4f81-929e-5bbd92a3ea7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:34.059676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89f72c-254a-4f81-929e-5bbd92a3ea7b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:34.079864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 527/1063] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:34.101832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:34.147063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2242-f26a-4bb9-92e2-c3a75a9e442b None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:34.147917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2242-f26a-4bb9-92e2-c3a75a9e442b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:34.148430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e2242-f26a-4bb9-92e2-c3a75a9e442b None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:34.153283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 528/1064] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:34.157620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410414-df64-4fe2-bbde-e097f3ee0e17 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:34.158035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410414-df64-4fe2-bbde-e097f3ee0e17 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:34.158453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410414-df64-4fe2-bbde-e097f3ee0e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:34.178737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-05410414-df64-4fe2-bbde-e097f3ee0e17 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:34.179945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-05410414-df64-4fe2-bbde-e097f3ee0e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:34.226080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 537/1065] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:13:34.232082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89f72c-254a-4f81-929e-5bbd92a3ea7b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:34.286047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 529/1066] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:34.358658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89f72c-254a-4f81-929e-5bbd92a3ea7b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:34.358927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410414-df64-4fe2-bbde-e097f3ee0e17 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:34.388717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:34.412448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc975d8-e1dd-4744-8fb4-1a84e45dcae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:34.413121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc975d8-e1dd-4744-8fb4-1a84e45dcae2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:34.413428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc975d8-e1dd-4744-8fb4-1a84e45dcae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:34.413703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc975d8-e1dd-4744-8fb4-1a84e45dcae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:34.437010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc975d8-e1dd-4744-8fb4-1a84e45dcae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:34.438607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc975d8-e1dd-4744-8fb4-1a84e45dcae2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-edc975d8-e1dd-4744-8fb4-1a84e45dcae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:34.459001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:34.460712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:34.462151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:34.462151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:34.462151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:34.462151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 538/1067] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:34.466635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc975d8-e1dd-4744-8fb4-1a84e45dcae2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:34.477126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:34.501538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410414-df64-4fe2-bbde-e097f3ee0e17 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:34.539748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bf751-a2a1-4ba2-abde-a3cd02ba536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:34.540406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bf751-a2a1-4ba2-abde-a3cd02ba536d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:34.540690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bf751-a2a1-4ba2-abde-a3cd02ba536d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:34.540961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bf751-a2a1-4ba2-abde-a3cd02ba536d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:34.553332 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bf751-a2a1-4ba2-abde-a3cd02ba536d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-b53bf751-a2a1-4ba2-abde-a3cd02ba536d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:34.558828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:34.559806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:34.560659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 530/1068] 10.222.0.61 () {56 vars in 1120 bytes} [Thu Sep 22 18:13:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:34.562103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bf751-a2a1-4ba2-abde-a3cd02ba536d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:34.592975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc975d8-e1dd-4744-8fb4-1a84e45dcae2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:34.636088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf06e9b-53f0-442a-a637-2e9fa725daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:34.636725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf06e9b-53f0-442a-a637-2e9fa725daec None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:34.636998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf06e9b-53f0-442a-a637-2e9fa725daec None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:34.637310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf06e9b-53f0-442a-a637-2e9fa725daec None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:34.637966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf06e9b-53f0-442a-a637-2e9fa725daec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:34.638271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf06e9b-53f0-442a-a637-2e9fa725daec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:34.639661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf06e9b-53f0-442a-a637-2e9fa725daec None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:34.665977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 539/1069] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:34.665977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf06e9b-53f0-442a-a637-2e9fa725daec None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:34.678420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bf751-a2a1-4ba2-abde-a3cd02ba536d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:34.724398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:34.736013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a0205-4abc-4158-9399-1b252183bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:34.736892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a0205-4abc-4158-9399-1b252183bdbd None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:34.737268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a0205-4abc-4158-9399-1b252183bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:34.737557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a0205-4abc-4158-9399-1b252183bdbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:34.747177 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:34.751952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a0205-4abc-4158-9399-1b252183bdbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-442a0205-4abc-4158-9399-1b252183bdbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:34.761044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:34.762266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:13:34.763132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:34.763792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 531/1070] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:34.770352 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a0205-4abc-4158-9399-1b252183bdbd None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:34.820291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf06e9b-53f0-442a-a637-2e9fa725daec None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:34.863732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdc38b-2970-4930-811c-f596030df176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:34.864355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdc38b-2970-4930-811c-f596030df176 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:34.864633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdc38b-2970-4930-811c-f596030df176 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:34.864902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdc38b-2970-4930-811c-f596030df176 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:34.865632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdc38b-2970-4930-811c-f596030df176 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:34.865935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdc38b-2970-4930-811c-f596030df176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:34.867302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdc38b-2970-4930-811c-f596030df176 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:34.876171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 540/1071] 10.222.0.61 () {56 vars in 1115 bytes} [Thu Sep 22 18:13:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:34.882850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdc38b-2970-4930-811c-f596030df176 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:34.901288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a0205-4abc-4158-9399-1b252183bdbd None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:34.941907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6671-795a-4321-b331-beff2b7046c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:34.942535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6671-795a-4321-b331-beff2b7046c2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:34.942817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6671-795a-4321-b331-beff2b7046c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:34.943093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6671-795a-4321-b331-beff2b7046c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:34.943787 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe6671-795a-4321-b331-beff2b7046c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:34.944100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe6671-795a-4321-b331-beff2b7046c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:34.945545 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe6671-795a-4321-b331-beff2b7046c2 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:34.956550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 532/1072] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:34.962935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6671-795a-4321-b331-beff2b7046c2 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:35.009526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:35.017614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdc38b-2970-4930-811c-f596030df176 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:35.052268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:35.056121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba3ceb-1558-4d6b-9dac-690b61e4b4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:35.056701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba3ceb-1558-4d6b-9dac-690b61e4b4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:35.056701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba3ceb-1558-4d6b-9dac-690b61e4b4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:35.056701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba3ceb-1558-4d6b-9dac-690b61e4b4d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:35.070022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba3ceb-1558-4d6b-9dac-690b61e4b4d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:35.071469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba3ceb-1558-4d6b-9dac-690b61e4b4d3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-ffba3ceb-1558-4d6b-9dac-690b61e4b4d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:35.090660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:35.091750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:35.092636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:35.092636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:35.092636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:35.092636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 541/1073] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:35.099081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba3ceb-1558-4d6b-9dac-690b61e4b4d3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:35.105656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6671-795a-4321-b331-beff2b7046c2 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:35.149805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57999-946e-4059-a728-ef736f239a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:35.150469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57999-946e-4059-a728-ef736f239a19 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:35.150801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57999-946e-4059-a728-ef736f239a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:35.150998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57999-946e-4059-a728-ef736f239a19 None admin] PATH_INFO: `/v3/users/4cfa3912876b44098d185c41f9b28c05` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:35.152168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be57999-946e-4059-a728-ef736f239a19 None admin] RBAC: Authorizing `identity:get_user(user_id=4cfa3912876b44098d185c41f9b28c05)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:35.153618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be57999-946e-4059-a728-ef736f239a19 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:35.155230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 533/1074] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:13:34 2022] GET /identity/v3/users/4cfa3912876b44098d185c41f9b28c05 => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:35.164176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57999-946e-4059-a728-ef736f239a19 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:35.220369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba3ceb-1558-4d6b-9dac-690b61e4b4d3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:35.262403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2be7-cb5a-4a2b-b384-fe2f2c13fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:35.262937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2be7-cb5a-4a2b-b384-fe2f2c13fc78 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:35.263222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2be7-cb5a-4a2b-b384-fe2f2c13fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:35.263501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2be7-cb5a-4a2b-b384-fe2f2c13fc78 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:35.264152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa2be7-cb5a-4a2b-b384-fe2f2c13fc78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:35.264491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa2be7-cb5a-4a2b-b384-fe2f2c13fc78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:35.265908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa2be7-cb5a-4a2b-b384-fe2f2c13fc78 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:35.273373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57999-946e-4059-a728-ef736f239a19 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:35.278424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 542/1075] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:35.284276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2be7-cb5a-4a2b-b384-fe2f2c13fc78 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:35.295028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:35.306766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:35.313934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9854016-3de5-45ba-9d94-e39eb8afc749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:35.314586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9854016-3de5-45ba-9d94-e39eb8afc749 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:35.314872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9854016-3de5-45ba-9d94-e39eb8afc749 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:35.315150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9854016-3de5-45ba-9d94-e39eb8afc749 None admin] PATH_INFO: `/v3/projects/2a13ddd802804e1bbfbbd65a5047b547` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:35.316286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9854016-3de5-45ba-9d94-e39eb8afc749 None admin] RBAC: Authorizing `identity:get_project(project_id=2a13ddd802804e1bbfbbd65a5047b547)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:35.317774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9854016-3de5-45ba-9d94-e39eb8afc749 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:35.319611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 534/1076] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:13:35 2022] GET /identity/v3/projects/2a13ddd802804e1bbfbbd65a5047b547 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:35.326093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9854016-3de5-45ba-9d94-e39eb8afc749 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:35.393831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2be7-cb5a-4a2b-b384-fe2f2c13fc78 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:35.428940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d09bb8-e6a4-4683-abf8-22469c027ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:35.429608 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09bb8-e6a4-4683-abf8-22469c027ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:35.429895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09bb8-e6a4-4683-abf8-22469c027ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:35.430173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09bb8-e6a4-4683-abf8-22469c027ff2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:35.431458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9854016-3de5-45ba-9d94-e39eb8afc749 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:35.438135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d09bb8-e6a4-4683-abf8-22469c027ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:35.439588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d09bb8-e6a4-4683-abf8-22469c027ff2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-11d09bb8-e6a4-4683-abf8-22469c027ff2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:13:35.451717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:35.452764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:35.453765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 543/1077] 10.222.0.61 () {56 vars in 1093 bytes} [Thu Sep 22 18:13:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:35.458627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d09bb8-e6a4-4683-abf8-22469c027ff2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:35.466890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e965-49cd-42b3-9693-2f9d4ff3bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:35.467560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e965-49cd-42b3-9693-2f9d4ff3bfda None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:35.467837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e965-49cd-42b3-9693-2f9d4ff3bfda None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:35.468110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e965-49cd-42b3-9693-2f9d4ff3bfda None admin] PATH_INFO: `/v3/projects/2a13ddd802804e1bbfbbd65a5047b547/users/4cfa3912876b44098d185c41f9b28c05/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:35.472598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06e965-49cd-42b3-9693-2f9d4ff3bfda None admin] RBAC: Authorizing `identity:create_grant(project_id=2a13ddd802804e1bbfbbd65a5047b547, user_id=4cfa3912876b44098d185c41f9b28c05, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:35.474298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06e965-49cd-42b3-9693-2f9d4ff3bfda None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:35.497268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 535/1078] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:13:35 2022] PUT /identity/v3/projects/2a13ddd802804e1bbfbbd65a5047b547/users/4cfa3912876b44098d185c41f9b28c05/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:13:35.541204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:35.579187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d09bb8-e6a4-4683-abf8-22469c027ff2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:35.617075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655ca85-f698-453e-acfc-f7d0fdf94a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:35.617744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655ca85-f698-453e-acfc-f7d0fdf94a5b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:35.618023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655ca85-f698-453e-acfc-f7d0fdf94a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:35.618295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655ca85-f698-453e-acfc-f7d0fdf94a5b None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:35.619048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655ca85-f698-453e-acfc-f7d0fdf94a5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:35.619366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655ca85-f698-453e-acfc-f7d0fdf94a5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:35.620833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655ca85-f698-453e-acfc-f7d0fdf94a5b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:35.641844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 544/1079] 10.222.0.61 () {56 vars in 1133 bytes} [Thu Sep 22 18:13:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:35.648043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e965-49cd-42b3-9693-2f9d4ff3bfda None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:35.720333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:35.769660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e965-49cd-42b3-9693-2f9d4ff3bfda None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:35.805347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ebcc-726c-4c6b-98cc-3f303656ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:35.805936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ebcc-726c-4c6b-98cc-3f303656ad6a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:35.806220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ebcc-726c-4c6b-98cc-3f303656ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:35.806495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ebcc-726c-4c6b-98cc-3f303656ad6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:35.817230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99ebcc-726c-4c6b-98cc-3f303656ad6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:35.818699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99ebcc-726c-4c6b-98cc-3f303656ad6a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-da99ebcc-726c-4c6b-98cc-3f303656ad6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:35.833692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:35.834868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:35.835797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:35.835797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:35.835797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:35.835797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 536/1080] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:35.841798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655ca85-f698-453e-acfc-f7d0fdf94a5b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:35.945114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655ca85-f698-453e-acfc-f7d0fdf94a5b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:35.973333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:35.983842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01574-d09f-40b5-a64c-ab43edb63d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:35.984343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01574-d09f-40b5-a64c-ab43edb63d2d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:35.984650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01574-d09f-40b5-a64c-ab43edb63d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:35.984970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01574-d09f-40b5-a64c-ab43edb63d2d None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:35.985691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e01574-d09f-40b5-a64c-ab43edb63d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:35.986010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e01574-d09f-40b5-a64c-ab43edb63d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:35.987386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e01574-d09f-40b5-a64c-ab43edb63d2d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:35.999441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 545/1081] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:36.005229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ebcc-726c-4c6b-98cc-3f303656ad6a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:36.112234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ebcc-726c-4c6b-98cc-3f303656ad6a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:36.122988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:36.148430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6a3c9-1991-4292-b2b4-b3f92d77c16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:36.149123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6a3c9-1991-4292-b2b4-b3f92d77c16a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:36.149390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6a3c9-1991-4292-b2b4-b3f92d77c16a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:36.149702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6a3c9-1991-4292-b2b4-b3f92d77c16a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:36.156826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6a3c9-1991-4292-b2b4-b3f92d77c16a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:36.158363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6a3c9-1991-4292-b2b4-b3f92d77c16a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-aee6a3c9-1991-4292-b2b4-b3f92d77c16a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:13:36.170135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:36.172081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:36.172970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:13:36.172970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:13:36.172970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:13:36.172970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:13:36.172970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:13:36.172970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:13:36.172970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:36.172970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:36.176688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 537/1082] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:36.178183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01574-d09f-40b5-a64c-ab43edb63d2d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:36.292055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01574-d09f-40b5-a64c-ab43edb63d2d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:36.327385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf62e45-73b7-46e5-a253-06c50496934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:36.328713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf62e45-73b7-46e5-a253-06c50496934a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:36.329024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf62e45-73b7-46e5-a253-06c50496934a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:36.329364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf62e45-73b7-46e5-a253-06c50496934a None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:36.330169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf62e45-73b7-46e5-a253-06c50496934a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:36.330516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf62e45-73b7-46e5-a253-06c50496934a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:36.331958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf62e45-73b7-46e5-a253-06c50496934a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:36.346425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 546/1083] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:36.353253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6a3c9-1991-4292-b2b4-b3f92d77c16a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:36.471994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6a3c9-1991-4292-b2b4-b3f92d77c16a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:36.525814 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653fa0f-3cf8-45de-ab31-79c5cc95704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:36.526613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653fa0f-3cf8-45de-ab31-79c5cc95704c None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:36.526808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653fa0f-3cf8-45de-ab31-79c5cc95704c None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:36.527088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653fa0f-3cf8-45de-ab31-79c5cc95704c None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/d710bb85a200419aa071e119976115c6/roles/9d1b8b0e878a4d08ab0b856406a139ad` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:36.529441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653fa0f-3cf8-45de-ab31-79c5cc95704c None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=d710bb85a200419aa071e119976115c6, role_id=9d1b8b0e878a4d08ab0b856406a139ad)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:36.530912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653fa0f-3cf8-45de-ab31-79c5cc95704c None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:36.546336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 538/1084] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:13:36 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/d710bb85a200419aa071e119976115c6/roles/9d1b8b0e878a4d08ab0b856406a139ad => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:13:37.697752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc1f2-fe58-4a41-827b-6aa0d48c76e1 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:37.698265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc1f2-fe58-4a41-827b-6aa0d48c76e1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:37.698441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc1f2-fe58-4a41-827b-6aa0d48c76e1 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:37.700002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 547/1085] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:37.705864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f8b39-c983-44ea-8317-d70a284cc939 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:37.706360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f8b39-c983-44ea-8317-d70a284cc939 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:37.706453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f8b39-c983-44ea-8317-d70a284cc939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:37.725850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-7b7f8b39-c983-44ea-8317-d70a284cc939 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:37.727065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7b7f8b39-c983-44ea-8317-d70a284cc939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:37.754562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:37.807814 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 539/1086] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:38.083609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cc1f2-fe58-4a41-827b-6aa0d48c76e1 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:38.139215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:38.199653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cc1f2-fe58-4a41-827b-6aa0d48c76e1 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:38.251275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cc842-0e46-489b-8797-81c244cf0a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:38.251933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cc842-0e46-489b-8797-81c244cf0a83 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:38.252218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cc842-0e46-489b-8797-81c244cf0a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:38.252497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cc842-0e46-489b-8797-81c244cf0a83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:38.264320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cc842-0e46-489b-8797-81c244cf0a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-6e9cc842-0e46-489b-8797-81c244cf0a83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:38.269438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:38.270422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:38.271364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 548/1087] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:38.276629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f8b39-c983-44ea-8317-d70a284cc939 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:38.389028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f8b39-c983-44ea-8317-d70a284cc939 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:38.430195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100af88-4bb4-4587-af6b-a682ad238940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:38.430812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100af88-4bb4-4587-af6b-a682ad238940 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:38.431095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100af88-4bb4-4587-af6b-a682ad238940 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:38.431373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100af88-4bb4-4587-af6b-a682ad238940 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:38.432044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100af88-4bb4-4587-af6b-a682ad238940 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:38.432351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100af88-4bb4-4587-af6b-a682ad238940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:38.433772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100af88-4bb4-4587-af6b-a682ad238940 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:38.443069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 540/1088] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:13:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:38.449399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cc842-0e46-489b-8797-81c244cf0a83 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:38.563190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cc842-0e46-489b-8797-81c244cf0a83 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:38.571859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:38.605725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01b2f9-4cb1-4af9-87ae-a088dcab491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:38.606372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01b2f9-4cb1-4af9-87ae-a088dcab491f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:38.606660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01b2f9-4cb1-4af9-87ae-a088dcab491f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:38.606934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01b2f9-4cb1-4af9-87ae-a088dcab491f None admin] PATH_INFO: `/v3/users/4cfa3912876b44098d185c41f9b28c05` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:38.608134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01b2f9-4cb1-4af9-87ae-a088dcab491f None admin] RBAC: Authorizing `identity:get_user(user_id=4cfa3912876b44098d185c41f9b28c05)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:38.610265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01b2f9-4cb1-4af9-87ae-a088dcab491f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:38.612032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 549/1089] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:13:38 2022] GET /identity/v3/users/4cfa3912876b44098d185c41f9b28c05 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:38.619554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100af88-4bb4-4587-af6b-a682ad238940 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:38.652980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:38.742533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b148a-8339-4988-8c1b-bfb1aaf5744c None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:38.743081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b148a-8339-4988-8c1b-bfb1aaf5744c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:38.743081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b148a-8339-4988-8c1b-bfb1aaf5744c None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:38.744564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 550/1090] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:38.745095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100af88-4bb4-4587-af6b-a682ad238940 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:38.750483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e75a-ed89-448b-876f-11e6833c5ddc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:38.750778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e75a-ed89-448b-876f-11e6833c5ddc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:38.751062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e75a-ed89-448b-876f-11e6833c5ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:38.770120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1f29e75a-ed89-448b-876f-11e6833c5ddc None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:38.771448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1f29e75a-ed89-448b-876f-11e6833c5ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:38.782215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff6d40-b26b-4e84-8e32-2329aeca0845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:38.782864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff6d40-b26b-4e84-8e32-2329aeca0845 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:38.783188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff6d40-b26b-4e84-8e32-2329aeca0845 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:38.783460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff6d40-b26b-4e84-8e32-2329aeca0845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:38.852693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 551/1091] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:38.856560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff6d40-b26b-4e84-8e32-2329aeca0845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:38.858048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff6d40-b26b-4e84-8e32-2329aeca0845 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:38.883914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:38.964931 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 541/1092] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:13:38.971633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e75a-ed89-448b-876f-11e6833c5ddc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:39.079547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e75a-ed89-448b-876f-11e6833c5ddc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:39.082034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:39.116373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fdb77-8fee-4c37-8287-bd50dcd12995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:39.117041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fdb77-8fee-4c37-8287-bd50dcd12995 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:39.117355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fdb77-8fee-4c37-8287-bd50dcd12995 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:39.117634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fdb77-8fee-4c37-8287-bd50dcd12995 None admin] PATH_INFO: `/v3/projects/2a13ddd802804e1bbfbbd65a5047b547` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:39.118832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fdb77-8fee-4c37-8287-bd50dcd12995 None admin] RBAC: Authorizing `identity:get_project(project_id=2a13ddd802804e1bbfbbd65a5047b547)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:39.120291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fdb77-8fee-4c37-8287-bd50dcd12995 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:39.122026 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 552/1093] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:13:38 2022] GET /identity/v3/projects/2a13ddd802804e1bbfbbd65a5047b547 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:39.131254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff6d40-b26b-4e84-8e32-2329aeca0845 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:39.134353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fdb77-8fee-4c37-8287-bd50dcd12995 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:39.244908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff6d40-b26b-4e84-8e32-2329aeca0845 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:39.275999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:39.290540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34108e-822e-4245-b04f-f4760e7fb665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:39.291169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34108e-822e-4245-b04f-f4760e7fb665 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:39.291445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34108e-822e-4245-b04f-f4760e7fb665 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:39.291716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34108e-822e-4245-b04f-f4760e7fb665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:39.292467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34108e-822e-4245-b04f-f4760e7fb665 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=2a13ddd802804e1bbfbbd65a5047b547, user.id=4cfa3912876b44098d185c41f9b28c05) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:39.292594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fdb77-8fee-4c37-8287-bd50dcd12995 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:39.292780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34108e-822e-4245-b04f-f4760e7fb665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:39.294283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34108e-822e-4245-b04f-f4760e7fb665 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:39.300772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 542/1094] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:39 2022] GET /identity/v3/role_assignments?user.id=4cfa3912876b44098d185c41f9b28c05&scope.project.id=2a13ddd802804e1bbfbbd65a5047b547&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:39.349863 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa0e1a-1ed5-475e-a8e9-be8e2c8a2b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:39.350522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa0e1a-1ed5-475e-a8e9-be8e2c8a2b0e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:39.350797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa0e1a-1ed5-475e-a8e9-be8e2c8a2b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:39.351067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa0e1a-1ed5-475e-a8e9-be8e2c8a2b0e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:39.363803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa0e1a-1ed5-475e-a8e9-be8e2c8a2b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-19fa0e1a-1ed5-475e-a8e9-be8e2c8a2b0e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:13:39.368926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:39.370696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:39.371911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 553/1095] 10.222.0.61 () {56 vars in 1120 bytes} [Thu Sep 22 18:13:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:39.376504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34108e-822e-4245-b04f-f4760e7fb665 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:39.504179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34108e-822e-4245-b04f-f4760e7fb665 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:39.552686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d4d78-f98f-4f3a-87cf-69c012af7074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:39.553343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d4d78-f98f-4f3a-87cf-69c012af7074 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:39.553623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d4d78-f98f-4f3a-87cf-69c012af7074 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:39.553896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d4d78-f98f-4f3a-87cf-69c012af7074 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:39.555804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d4d78-f98f-4f3a-87cf-69c012af7074 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:39.556121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d4d78-f98f-4f3a-87cf-69c012af7074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:39.557552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d4d78-f98f-4f3a-87cf-69c012af7074 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:39.579242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 543/1096] 10.222.0.61 () {56 vars in 1115 bytes} [Thu Sep 22 18:13:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:39.580505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa0e1a-1ed5-475e-a8e9-be8e2c8a2b0e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:39.615346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:39.700614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa0e1a-1ed5-475e-a8e9-be8e2c8a2b0e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:39.739417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6117cb-883e-42b1-ab36-13bc283c10aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:39.740068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6117cb-883e-42b1-ab36-13bc283c10aa None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:39.740350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6117cb-883e-42b1-ab36-13bc283c10aa None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:39.740617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6117cb-883e-42b1-ab36-13bc283c10aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:39.751489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6117cb-883e-42b1-ab36-13bc283c10aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:39.752944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6117cb-883e-42b1-ab36-13bc283c10aa None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-fd6117cb-883e-42b1-ab36-13bc283c10aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:39.768298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:39.769418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:39.770296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:39.770296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:39.770296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:39.770296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 554/1097] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:39.775784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d4d78-f98f-4f3a-87cf-69c012af7074 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:39.829673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:39.888901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d4d78-f98f-4f3a-87cf-69c012af7074 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:39.926986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0abd13-e551-48e2-b297-17ad622aecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:39.927608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0abd13-e551-48e2-b297-17ad622aecbe None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:39.927884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0abd13-e551-48e2-b297-17ad622aecbe None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:39.928163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0abd13-e551-48e2-b297-17ad622aecbe None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:39.928803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0abd13-e551-48e2-b297-17ad622aecbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:39.929106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0abd13-e551-48e2-b297-17ad622aecbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:39.930582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0abd13-e551-48e2-b297-17ad622aecbe None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:39.942689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 544/1098] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:39.949332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6117cb-883e-42b1-ab36-13bc283c10aa None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:40.040273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:40.057487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6117cb-883e-42b1-ab36-13bc283c10aa None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:40.094703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a97a0-d567-470d-8c4f-cf76fec5f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:40.095351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a97a0-d567-470d-8c4f-cf76fec5f42d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:40.095627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a97a0-d567-470d-8c4f-cf76fec5f42d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:40.095895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a97a0-d567-470d-8c4f-cf76fec5f42d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:40.104187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a97a0-d567-470d-8c4f-cf76fec5f42d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:40.105699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a97a0-d567-470d-8c4f-cf76fec5f42d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-a12a97a0-d567-470d-8c4f-cf76fec5f42d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:13:40.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:40.118820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:13:40.119813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 555/1099] 10.222.0.61 () {56 vars in 1093 bytes} [Thu Sep 22 18:13:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:40.125480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0abd13-e551-48e2-b297-17ad622aecbe None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:40.248564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0abd13-e551-48e2-b297-17ad622aecbe None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:40.264087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:40.299074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fddaae-9818-4ac4-8f4a-0d77e674c45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:40.299607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fddaae-9818-4ac4-8f4a-0d77e674c45b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:40.299894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fddaae-9818-4ac4-8f4a-0d77e674c45b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:40.300163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fddaae-9818-4ac4-8f4a-0d77e674c45b None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:40.300899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fddaae-9818-4ac4-8f4a-0d77e674c45b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:40.301204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fddaae-9818-4ac4-8f4a-0d77e674c45b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:40.302661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fddaae-9818-4ac4-8f4a-0d77e674c45b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:40.321178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 545/1100] 10.222.0.61 () {56 vars in 1133 bytes} [Thu Sep 22 18:13:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:40.327070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a97a0-d567-470d-8c4f-cf76fec5f42d None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:40.438468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a97a0-d567-470d-8c4f-cf76fec5f42d None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:40.476506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ae948-5e27-4309-833c-7ca271a6fb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:40.477166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ae948-5e27-4309-833c-7ca271a6fb55 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:40.477550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ae948-5e27-4309-833c-7ca271a6fb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:40.477829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ae948-5e27-4309-833c-7ca271a6fb55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:40.495694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:40.559548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ae948-5e27-4309-833c-7ca271a6fb55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:40.561062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ae948-5e27-4309-833c-7ca271a6fb55 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:40.667995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 556/1101] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 18:13:40.674827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fddaae-9818-4ac4-8f4a-0d77e674c45b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:40.790119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fddaae-9818-4ac4-8f4a-0d77e674c45b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:40.828793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6de52-4ecb-4f2f-94cf-d88bf123db1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:40.829440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6de52-4ecb-4f2f-94cf-d88bf123db1a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:40.829837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6de52-4ecb-4f2f-94cf-d88bf123db1a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:40.830068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6de52-4ecb-4f2f-94cf-d88bf123db1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:40.841106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6de52-4ecb-4f2f-94cf-d88bf123db1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:40.842576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6de52-4ecb-4f2f-94cf-d88bf123db1a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-e6c6de52-4ecb-4f2f-94cf-d88bf123db1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:13:40.860823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:40.861891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:13:40.862789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:13:40.862789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:13:40.862789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:40.862789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 546/1102] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:13:40.867974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ae948-5e27-4309-833c-7ca271a6fb55 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:40.917649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:40.978723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ae948-5e27-4309-833c-7ca271a6fb55 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:41.018322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479d2b-f355-4cf9-8eb9-c6fbe21122b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:41.018944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479d2b-f355-4cf9-8eb9-c6fbe21122b0 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:41.019245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479d2b-f355-4cf9-8eb9-c6fbe21122b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:41.019616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479d2b-f355-4cf9-8eb9-c6fbe21122b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:41.020142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479d2b-f355-4cf9-8eb9-c6fbe21122b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:41.020707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479d2b-f355-4cf9-8eb9-c6fbe21122b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:41.021843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479d2b-f355-4cf9-8eb9-c6fbe21122b0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:41.034436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 557/1103] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:41.040624 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6de52-4ecb-4f2f-94cf-d88bf123db1a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:41.061405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:41.150251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6de52-4ecb-4f2f-94cf-d88bf123db1a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:41.186903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356b4db-b4f7-4336-9ae9-7be9efce25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:41.187581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356b4db-b4f7-4336-9ae9-7be9efce25be None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:41.187864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356b4db-b4f7-4336-9ae9-7be9efce25be None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:41.194475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356b4db-b4f7-4336-9ae9-7be9efce25be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:41.205182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356b4db-b4f7-4336-9ae9-7be9efce25be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:41.208093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356b4db-b4f7-4336-9ae9-7be9efce25be None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-e356b4db-b4f7-4336-9ae9-7be9efce25be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:13:41.231516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:13:41.232723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:13:41.233889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:13:41.233889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:13:41.233889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:13:41.233889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:13:41.233889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:13:41.233889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:13:41.233889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:13:41.233889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:13:41.234534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 547/1104] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:13:41.239805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479d2b-f355-4cf9-8eb9-c6fbe21122b0 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:41.358071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479d2b-f355-4cf9-8eb9-c6fbe21122b0 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:41.360684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:41.396096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1950b8-d9d0-4573-8e3b-ec144b86291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:41.396723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1950b8-d9d0-4573-8e3b-ec144b86291e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:41.397010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1950b8-d9d0-4573-8e3b-ec144b86291e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:41.397314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1950b8-d9d0-4573-8e3b-ec144b86291e None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:41.398021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1950b8-d9d0-4573-8e3b-ec144b86291e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:41.398324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1950b8-d9d0-4573-8e3b-ec144b86291e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:41.399884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1950b8-d9d0-4573-8e3b-ec144b86291e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:41.414242 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 558/1105] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:41.420788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356b4db-b4f7-4336-9ae9-7be9efce25be None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:41.510878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:41.536856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356b4db-b4f7-4336-9ae9-7be9efce25be None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:41.574990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bf109-33e6-4ac6-a415-6a73fa56cab7 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:41.575311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bf109-33e6-4ac6-a415-6a73fa56cab7 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:41.575535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bf109-33e6-4ac6-a415-6a73fa56cab7 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:41.575652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9339da-4c71-47c7-8fc1-5cdacdf70c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:41.576320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9339da-4c71-47c7-8fc1-5cdacdf70c0d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:41.576628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9339da-4c71-47c7-8fc1-5cdacdf70c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:41.576884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 559/1106] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:13:41.577075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9339da-4c71-47c7-8fc1-5cdacdf70c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:41.578553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9339da-4c71-47c7-8fc1-5cdacdf70c0d None admin] RBAC: Adding query filter params (role.id=9d1b8b0e878a4d08ab0b856406a139ad, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=d710bb85a200419aa071e119976115c6) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:41.578937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9339da-4c71-47c7-8fc1-5cdacdf70c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:41.580359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9339da-4c71-47c7-8fc1-5cdacdf70c0d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:41.583172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c60f-560d-4300-bc16-cb7d915866c3 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:41.583565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c60f-560d-4300-bc16-cb7d915866c3 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:41.584039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c60f-560d-4300-bc16-cb7d915866c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:41.587003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 548/1107] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:41 2022] GET /identity/v3/role_assignments?user.id=d710bb85a200419aa071e119976115c6&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=9d1b8b0e878a4d08ab0b856406a139ad => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:41.605488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1195c60f-560d-4300-bc16-cb7d915866c3 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:41.606869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1195c60f-560d-4300-bc16-cb7d915866c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:41.691701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 560/1108] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:41.965524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9339da-4c71-47c7-8fc1-5cdacdf70c0d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:42.081696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9339da-4c71-47c7-8fc1-5cdacdf70c0d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:42.123407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313d339-26fd-444b-9180-bf8e228fbe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:42.124057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d339-26fd-444b-9180-bf8e228fbe70 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:42.124348 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d339-26fd-444b-9180-bf8e228fbe70 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:42.124619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d339-26fd-444b-9180-bf8e228fbe70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:42.127000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313d339-26fd-444b-9180-bf8e228fbe70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:42.128453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313d339-26fd-444b-9180-bf8e228fbe70 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:42.130100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 549/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:42.136632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c60f-560d-4300-bc16-cb7d915866c3 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:42.265575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:42.274094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c60f-560d-4300-bc16-cb7d915866c3 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:42.315423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49cf79-246f-48ab-9052-04f012d915ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:42.316052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49cf79-246f-48ab-9052-04f012d915ee None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:42.316335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49cf79-246f-48ab-9052-04f012d915ee None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:42.316611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49cf79-246f-48ab-9052-04f012d915ee None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:42.317315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49cf79-246f-48ab-9052-04f012d915ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:42.318769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49cf79-246f-48ab-9052-04f012d915ee None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:42.352628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 561/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:13:42 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:13:44.648914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac16535-ac24-4be7-a9f5-6c32a5d9f11c None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:44.649491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac16535-ac24-4be7-a9f5-6c32a5d9f11c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:44.649491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac16535-ac24-4be7-a9f5-6c32a5d9f11c None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:44.650889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 550/1111] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:44.656763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae93838-0699-44b3-92eb-e55511514315 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:44.657204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae93838-0699-44b3-92eb-e55511514315 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:44.657387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae93838-0699-44b3-92eb-e55511514315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:44.677989 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5ae93838-0699-44b3-92eb-e55511514315 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:44.679213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5ae93838-0699-44b3-92eb-e55511514315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:44.746120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 562/1112] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:45.023702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac16535-ac24-4be7-a9f5-6c32a5d9f11c None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:45.039695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:45.139118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac16535-ac24-4be7-a9f5-6c32a5d9f11c None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:45.175541 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee055a4-1553-4ff7-b952-9c3c4fe41103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:45.176183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee055a4-1553-4ff7-b952-9c3c4fe41103 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:45.176465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee055a4-1553-4ff7-b952-9c3c4fe41103 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:45.176741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee055a4-1553-4ff7-b952-9c3c4fe41103 None admin] PATH_INFO: `/v3/roles/3ba0b7b6bdc646f586a35aafc5c739f2` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:45.178175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee055a4-1553-4ff7-b952-9c3c4fe41103 None admin] RBAC: Authorizing `identity:get_role(role_id=3ba0b7b6bdc646f586a35aafc5c739f2)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:45.179552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee055a4-1553-4ff7-b952-9c3c4fe41103 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:45.180896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 551/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:13:45 2022] GET /identity/v3/roles/3ba0b7b6bdc646f586a35aafc5c739f2 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:45.186802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae93838-0699-44b3-92eb-e55511514315 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:45.276335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:45.299008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae93838-0699-44b3-92eb-e55511514315 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:45.334407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf97c4-7f4e-4255-bc81-0b5d0101586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:45.335070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf97c4-7f4e-4255-bc81-0b5d0101586f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:45.335357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf97c4-7f4e-4255-bc81-0b5d0101586f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:45.335636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf97c4-7f4e-4255-bc81-0b5d0101586f None admin] PATH_INFO: `/v3/users/2a74b383c461452a8473ed4f5271a8bf` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:45.351440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf97c4-7f4e-4255-bc81-0b5d0101586f None admin] RBAC: Authorizing `identity:get_user(user_id=2a74b383c461452a8473ed4f5271a8bf)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:45.353091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf97c4-7f4e-4255-bc81-0b5d0101586f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:45.355067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 563/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:13:45 2022] GET /identity/v3/users/2a74b383c461452a8473ed4f5271a8bf => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:45.361674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee055a4-1553-4ff7-b952-9c3c4fe41103 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:45.446574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:45.471453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee055a4-1553-4ff7-b952-9c3c4fe41103 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:45.508749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f239d-c573-4d60-9d08-7bb8b64eb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:45.509421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f239d-c573-4d60-9d08-7bb8b64eb01b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:45.509730 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f239d-c573-4d60-9d08-7bb8b64eb01b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:45.510028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f239d-c573-4d60-9d08-7bb8b64eb01b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:45.589045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f239d-c573-4d60-9d08-7bb8b64eb01b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:45.590729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f239d-c573-4d60-9d08-7bb8b64eb01b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:45.678146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:45.701513 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 552/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:13:45.708693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf97c4-7f4e-4255-bc81-0b5d0101586f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:45.820095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf97c4-7f4e-4255-bc81-0b5d0101586f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:45.856292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917681b9-6c50-47cc-b631-ac3bb097bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:45.856853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917681b9-6c50-47cc-b631-ac3bb097bacf None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:45.857143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917681b9-6c50-47cc-b631-ac3bb097bacf None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:45.857456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917681b9-6c50-47cc-b631-ac3bb097bacf None admin] PATH_INFO: `/v3/projects/2a13ddd802804e1bbfbbd65a5047b547` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:45.858593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917681b9-6c50-47cc-b631-ac3bb097bacf None admin] RBAC: Authorizing `identity:get_project(project_id=2a13ddd802804e1bbfbbd65a5047b547)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:45.860031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917681b9-6c50-47cc-b631-ac3bb097bacf None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:45.861720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 564/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:13:45 2022] GET /identity/v3/projects/2a13ddd802804e1bbfbbd65a5047b547 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:45.868292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f239d-c573-4d60-9d08-7bb8b64eb01b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:45.974102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f239d-c573-4d60-9d08-7bb8b64eb01b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:46.012120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492b7b0-5b1d-4583-9ae1-f1057a8c7276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:46.012805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492b7b0-5b1d-4583-9ae1-f1057a8c7276 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:46.013088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492b7b0-5b1d-4583-9ae1-f1057a8c7276 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:46.013396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492b7b0-5b1d-4583-9ae1-f1057a8c7276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:46.014257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492b7b0-5b1d-4583-9ae1-f1057a8c7276 None admin] RBAC: Adding query filter params (role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=2a13ddd802804e1bbfbbd65a5047b547, user.id=2a74b383c461452a8473ed4f5271a8bf) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:46.014602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492b7b0-5b1d-4583-9ae1-f1057a8c7276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:46.016878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492b7b0-5b1d-4583-9ae1-f1057a8c7276 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:46.024654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 553/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:45 2022] GET /identity/v3/role_assignments?user.id=2a74b383c461452a8473ed4f5271a8bf&scope.project.id=2a13ddd802804e1bbfbbd65a5047b547&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:48.313146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d99aa7-2782-46b6-a9cd-cc8625f253cf None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:48.313768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d99aa7-2782-46b6-a9cd-cc8625f253cf None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:48.313768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d99aa7-2782-46b6-a9cd-cc8625f253cf None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:48.315345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 565/1118] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:48.321902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215d22-737a-4eed-af48-9dad1867201a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:48.322406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215d22-737a-4eed-af48-9dad1867201a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:48.322902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215d22-737a-4eed-af48-9dad1867201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:48.344595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-49215d22-737a-4eed-af48-9dad1867201a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:48.345843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-49215d22-737a-4eed-af48-9dad1867201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:48.384432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:48.417671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 554/1119] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:48.700300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d99aa7-2782-46b6-a9cd-cc8625f253cf None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:48.710129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:48.811441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d99aa7-2782-46b6-a9cd-cc8625f253cf None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:48.848595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f5109-2bbc-443e-874a-dd795bb76747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:48.849314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f5109-2bbc-443e-874a-dd795bb76747 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:48.849602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f5109-2bbc-443e-874a-dd795bb76747 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:48.849880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f5109-2bbc-443e-874a-dd795bb76747 None admin] PATH_INFO: `/v3/roles/3ba0b7b6bdc646f586a35aafc5c739f2` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:48.851479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f5109-2bbc-443e-874a-dd795bb76747 None admin] RBAC: Authorizing `identity:get_role(role_id=3ba0b7b6bdc646f586a35aafc5c739f2)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:48.852968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f5109-2bbc-443e-874a-dd795bb76747 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:48.854668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 566/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:13:48 2022] GET /identity/v3/roles/3ba0b7b6bdc646f586a35aafc5c739f2 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:48.860750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49215d22-737a-4eed-af48-9dad1867201a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:48.967743 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49215d22-737a-4eed-af48-9dad1867201a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:49.004133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35da4-eee4-4b51-930b-bc320d8ecf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:49.004779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35da4-eee4-4b51-930b-bc320d8ecf40 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:49.005061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35da4-eee4-4b51-930b-bc320d8ecf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:49.005364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35da4-eee4-4b51-930b-bc320d8ecf40 None admin] PATH_INFO: `/v3/users/2a74b383c461452a8473ed4f5271a8bf` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:49.006510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35da4-eee4-4b51-930b-bc320d8ecf40 None admin] RBAC: Authorizing `identity:get_user(user_id=2a74b383c461452a8473ed4f5271a8bf)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:49.007946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35da4-eee4-4b51-930b-bc320d8ecf40 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:49.009574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 555/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:13:48 2022] GET /identity/v3/users/2a74b383c461452a8473ed4f5271a8bf => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:49.016502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f5109-2bbc-443e-874a-dd795bb76747 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:49.094387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:49.120461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f5109-2bbc-443e-874a-dd795bb76747 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:49.157850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528cec-f4c8-46ff-a270-5d8f7bf242ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:49.158504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528cec-f4c8-46ff-a270-5d8f7bf242ea None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:49.158790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528cec-f4c8-46ff-a270-5d8f7bf242ea None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:49.159069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528cec-f4c8-46ff-a270-5d8f7bf242ea None admin] PATH_INFO: `/v3/projects/2a13ddd802804e1bbfbbd65a5047b547` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:49.160426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4528cec-f4c8-46ff-a270-5d8f7bf242ea None admin] RBAC: Authorizing `identity:get_project(project_id=2a13ddd802804e1bbfbbd65a5047b547)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:49.161924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4528cec-f4c8-46ff-a270-5d8f7bf242ea None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:49.163681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 567/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:13:49 2022] GET /identity/v3/projects/2a13ddd802804e1bbfbbd65a5047b547 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:49.174293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35da4-eee4-4b51-930b-bc320d8ecf40 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:49.223554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:49.285795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35da4-eee4-4b51-930b-bc320d8ecf40 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:49.320470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11f512-da15-45f5-b73d-888d36324e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:49.321146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11f512-da15-45f5-b73d-888d36324e90 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:49.321465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11f512-da15-45f5-b73d-888d36324e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:49.321746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11f512-da15-45f5-b73d-888d36324e90 None admin] PATH_INFO: `/v3/projects/2a13ddd802804e1bbfbbd65a5047b547/users/2a74b383c461452a8473ed4f5271a8bf/roles/3ba0b7b6bdc646f586a35aafc5c739f2` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:49.323926 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11f512-da15-45f5-b73d-888d36324e90 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a13ddd802804e1bbfbbd65a5047b547, user_id=2a74b383c461452a8473ed4f5271a8bf, role_id=3ba0b7b6bdc646f586a35aafc5c739f2)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:49.325417 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11f512-da15-45f5-b73d-888d36324e90 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:49.341604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 556/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:13:49 2022] PUT /identity/v3/projects/2a13ddd802804e1bbfbbd65a5047b547/users/2a74b383c461452a8473ed4f5271a8bf/roles/3ba0b7b6bdc646f586a35aafc5c739f2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:13:51.555962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a452a8e-a4c8-4465-8e1c-3895e364f6ac None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:51.556718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a452a8e-a4c8-4465-8e1c-3895e364f6ac None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:51.556718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a452a8e-a4c8-4465-8e1c-3895e364f6ac None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:51.557863 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 568/1124] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:51.563922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bfd98-9c8e-4719-9316-faf148205b8e None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:51.564436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bfd98-9c8e-4719-9316-faf148205b8e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:51.564526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bfd98-9c8e-4719-9316-faf148205b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:51.583434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8d3bfd98-9c8e-4719-9316-faf148205b8e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:51.584637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8d3bfd98-9c8e-4719-9316-faf148205b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:51.654332 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 557/1125] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:13:51.927466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a452a8e-a4c8-4465-8e1c-3895e364f6ac None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:52.041796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a452a8e-a4c8-4465-8e1c-3895e364f6ac None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:52.079297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca7ca-132b-4fa0-80ef-a148faf13a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:52.079948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca7ca-132b-4fa0-80ef-a148faf13a6c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:52.080228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca7ca-132b-4fa0-80ef-a148faf13a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:52.080503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca7ca-132b-4fa0-80ef-a148faf13a6c None admin] PATH_INFO: `/v3/roles/3ba0b7b6bdc646f586a35aafc5c739f2` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:52.081940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ca7ca-132b-4fa0-80ef-a148faf13a6c None admin] RBAC: Authorizing `identity:get_role(role_id=3ba0b7b6bdc646f586a35aafc5c739f2)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:52.083306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ca7ca-132b-4fa0-80ef-a148faf13a6c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:52.084658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 569/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:13:51 2022] GET /identity/v3/roles/3ba0b7b6bdc646f586a35aafc5c739f2 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:52.090916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bfd98-9c8e-4719-9316-faf148205b8e None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:52.130306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:52.203632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bfd98-9c8e-4719-9316-faf148205b8e None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:52.241571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0ca40-8c60-42e8-b92c-2555dec3c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:52.242217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0ca40-8c60-42e8-b92c-2555dec3c76f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:52.242501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0ca40-8c60-42e8-b92c-2555dec3c76f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:52.242754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0ca40-8c60-42e8-b92c-2555dec3c76f None admin] PATH_INFO: `/v3/users/2a74b383c461452a8473ed4f5271a8bf` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:52.243915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0ca40-8c60-42e8-b92c-2555dec3c76f None admin] RBAC: Authorizing `identity:get_user(user_id=2a74b383c461452a8473ed4f5271a8bf)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:52.245373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0ca40-8c60-42e8-b92c-2555dec3c76f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:52.246953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 558/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:13:52 2022] GET /identity/v3/users/2a74b383c461452a8473ed4f5271a8bf => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:52.253190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca7ca-132b-4fa0-80ef-a148faf13a6c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:52.266841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:52.380735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca7ca-132b-4fa0-80ef-a148faf13a6c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:52.425196 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8702-287d-4bde-bdee-8bee0ebccd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:52.425917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8702-287d-4bde-bdee-8bee0ebccd8b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:52.426254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8702-287d-4bde-bdee-8bee0ebccd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:52.426562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8702-287d-4bde-bdee-8bee0ebccd8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:52.515958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8702-287d-4bde-bdee-8bee0ebccd8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:52.517578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8702-287d-4bde-bdee-8bee0ebccd8b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:52.531380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:52.639905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 570/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:13:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 18:13:52.647573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0ca40-8c60-42e8-b92c-2555dec3c76f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:52.800918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:52.804912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0ca40-8c60-42e8-b92c-2555dec3c76f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:52.845371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34834f-8b4a-4a66-967e-a05e9464c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:52.846024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34834f-8b4a-4a66-967e-a05e9464c9ca None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:52.846303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34834f-8b4a-4a66-967e-a05e9464c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:52.846573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34834f-8b4a-4a66-967e-a05e9464c9ca None admin] PATH_INFO: `/v3/projects/2a13ddd802804e1bbfbbd65a5047b547` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:52.847752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34834f-8b4a-4a66-967e-a05e9464c9ca None admin] RBAC: Authorizing `identity:get_project(project_id=2a13ddd802804e1bbfbbd65a5047b547)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:52.849205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34834f-8b4a-4a66-967e-a05e9464c9ca None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:52.850950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 559/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:13:52 2022] GET /identity/v3/projects/2a13ddd802804e1bbfbbd65a5047b547 => generated 311 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:52.857548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8702-287d-4bde-bdee-8bee0ebccd8b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:52.973061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8702-287d-4bde-bdee-8bee0ebccd8b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:52.986717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:53.013995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9ea12-7bd7-49a9-8002-205ddfe8f49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:53.014798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ea12-7bd7-49a9-8002-205ddfe8f49d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:53.015227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ea12-7bd7-49a9-8002-205ddfe8f49d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:53.015676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ea12-7bd7-49a9-8002-205ddfe8f49d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:53.016523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ea12-7bd7-49a9-8002-205ddfe8f49d None admin] RBAC: Adding query filter params (role.id=3ba0b7b6bdc646f586a35aafc5c739f2, scope.project.id=2a13ddd802804e1bbfbbd65a5047b547, user.id=2a74b383c461452a8473ed4f5271a8bf) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:13:53.016919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ea12-7bd7-49a9-8002-205ddfe8f49d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:53.018562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ea12-7bd7-49a9-8002-205ddfe8f49d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:53.028477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 571/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:13:52 2022] GET /identity/v3/role_assignments?user.id=2a74b383c461452a8473ed4f5271a8bf&scope.project.id=2a13ddd802804e1bbfbbd65a5047b547&role.id=3ba0b7b6bdc646f586a35aafc5c739f2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:13:55.314138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6591-c6f8-4a98-bd41-02bddcc21e5f None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:55.314691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6591-c6f8-4a98-bd41-02bddcc21e5f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:55.314691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6591-c6f8-4a98-bd41-02bddcc21e5f None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:55.316192 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 560/1131] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:55.323384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c050d3-7daf-4890-a3e7-f80be83370ca None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:55.323939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c050d3-7daf-4890-a3e7-f80be83370ca None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:55.324036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c050d3-7daf-4890-a3e7-f80be83370ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:55.344452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-40c050d3-7daf-4890-a3e7-f80be83370ca None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:55.345778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-40c050d3-7daf-4890-a3e7-f80be83370ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:55.440209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 572/1132] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:55.708008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d6591-c6f8-4a98-bd41-02bddcc21e5f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:55.808962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d6591-c6f8-4a98-bd41-02bddcc21e5f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:55.846743 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1e5ef-75f4-4edc-a4ff-7b9268eaf40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:55.847552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1e5ef-75f4-4edc-a4ff-7b9268eaf40f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:55.847832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1e5ef-75f4-4edc-a4ff-7b9268eaf40f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:55.848110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1e5ef-75f4-4edc-a4ff-7b9268eaf40f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:55.849449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1e5ef-75f4-4edc-a4ff-7b9268eaf40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:55.850896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1e5ef-75f4-4edc-a4ff-7b9268eaf40f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:55.852488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 561/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:55.858367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c050d3-7daf-4890-a3e7-f80be83370ca None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:55.959495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c050d3-7daf-4890-a3e7-f80be83370ca None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:55.961788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:55.995235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded5f52-37a5-4526-a323-a12e850c7aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:55.995855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded5f52-37a5-4526-a323-a12e850c7aaf None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:55.996147 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded5f52-37a5-4526-a323-a12e850c7aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:55.996428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded5f52-37a5-4526-a323-a12e850c7aaf None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:55.997100 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded5f52-37a5-4526-a323-a12e850c7aaf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:55.998581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded5f52-37a5-4526-a323-a12e850c7aaf None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:56.026565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 573/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:13:55 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:13:58.246434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002015-610c-4a20-8268-b79b19c1e340 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:58.247048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002015-610c-4a20-8268-b79b19c1e340 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:58.247048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002015-610c-4a20-8268-b79b19c1e340 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:58.248318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 562/1135] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:13:58.254101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83abd57-e9c6-4a8c-8b14-17831de7a6f7 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:58.254702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83abd57-e9c6-4a8c-8b14-17831de7a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:58.254702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83abd57-e9c6-4a8c-8b14-17831de7a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:58.273680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c83abd57-e9c6-4a8c-8b14-17831de7a6f7 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:13:58.274909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c83abd57-e9c6-4a8c-8b14-17831de7a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:13:58.347410 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 574/1136] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:13:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:13:58.620761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6002015-610c-4a20-8268-b79b19c1e340 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:58.656760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:58.728639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6002015-610c-4a20-8268-b79b19c1e340 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:58.764739 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ff07b-57e2-4054-aeed-8f5bcdeea1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:58.765519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff07b-57e2-4054-aeed-8f5bcdeea1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:58.765928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff07b-57e2-4054-aeed-8f5bcdeea1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:58.766203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff07b-57e2-4054-aeed-8f5bcdeea1c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:58.767443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ff07b-57e2-4054-aeed-8f5bcdeea1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:58.768823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ff07b-57e2-4054-aeed-8f5bcdeea1c3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:58.770450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 563/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:13:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:13:58.776431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83abd57-e9c6-4a8c-8b14-17831de7a6f7 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:13:58.863068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:13:58.880044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83abd57-e9c6-4a8c-8b14-17831de7a6f7 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:13:58.915976 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f65df-9c97-48c6-ac49-e06ada3c693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:13:58.916606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f65df-9c97-48c6-ac49-e06ada3c693a None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:13:58.916890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f65df-9c97-48c6-ac49-e06ada3c693a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:13:58.917168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f65df-9c97-48c6-ac49-e06ada3c693a None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:13:58.917871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f65df-9c97-48c6-ac49-e06ada3c693a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:13:58.919320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f65df-9c97-48c6-ac49-e06ada3c693a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:13:58.941816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 575/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:13:58 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:14:01.230325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4f72a-384f-4eb7-8231-a0d91bc8ded1 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:01.230916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4f72a-384f-4eb7-8231-a0d91bc8ded1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:01.230916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4f72a-384f-4eb7-8231-a0d91bc8ded1 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:01.232210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 564/1139] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:14:01.238979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f2a0d-712a-4987-97e0-2c5fd1934e96 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:01.239484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f2a0d-712a-4987-97e0-2c5fd1934e96 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:01.239585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f2a0d-712a-4987-97e0-2c5fd1934e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:01.258274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-ec5f2a0d-712a-4987-97e0-2c5fd1934e96 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:01.259505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ec5f2a0d-712a-4987-97e0-2c5fd1934e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:01.328833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 576/1140] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:01.596864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4f72a-384f-4eb7-8231-a0d91bc8ded1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:01.698646 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4f72a-384f-4eb7-8231-a0d91bc8ded1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:01.700143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:01.738086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1e478-6647-4dd3-80bd-8302579451f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:01.738720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e478-6647-4dd3-80bd-8302579451f2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:01.739001 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e478-6647-4dd3-80bd-8302579451f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:01.739278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e478-6647-4dd3-80bd-8302579451f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:01.749312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1e478-6647-4dd3-80bd-8302579451f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-87c1e478-6647-4dd3-80bd-8302579451f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:14:01.754607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:14:01.756199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:14:01.757435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 565/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:14:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:14:01.762490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f2a0d-712a-4987-97e0-2c5fd1934e96 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:01.829970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:01.859346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f2a0d-712a-4987-97e0-2c5fd1934e96 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:01.892009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c52270-a56c-4cf6-a55d-425ac1ace609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:01.892605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c52270-a56c-4cf6-a55d-425ac1ace609 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:01.892885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c52270-a56c-4cf6-a55d-425ac1ace609 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:01.893156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c52270-a56c-4cf6-a55d-425ac1ace609 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:01.893839 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c52270-a56c-4cf6-a55d-425ac1ace609 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:01.894135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c52270-a56c-4cf6-a55d-425ac1ace609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:01.895485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c52270-a56c-4cf6-a55d-425ac1ace609 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:01.903593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 577/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:14:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:14:01.910111 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1e478-6647-4dd3-80bd-8302579451f2 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:02.008688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1e478-6647-4dd3-80bd-8302579451f2 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:02.043701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35b1e1-c879-44dd-ac18-1d1f56565b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:02.044336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35b1e1-c879-44dd-ac18-1d1f56565b7f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:02.044614 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35b1e1-c879-44dd-ac18-1d1f56565b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:02.044888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35b1e1-c879-44dd-ac18-1d1f56565b7f None admin] PATH_INFO: `/v3/users/86c83f7bc94b4e5ea0da2a04d0745fde` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:02.059825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35b1e1-c879-44dd-ac18-1d1f56565b7f None admin] RBAC: Authorizing `identity:get_user(user_id=86c83f7bc94b4e5ea0da2a04d0745fde)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:02.061307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35b1e1-c879-44dd-ac18-1d1f56565b7f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:02.063037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 566/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:14:01 2022] GET /identity/v3/users/86c83f7bc94b4e5ea0da2a04d0745fde => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:02.069047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c52270-a56c-4cf6-a55d-425ac1ace609 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:02.171578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c52270-a56c-4cf6-a55d-425ac1ace609 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:02.207650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b44db-7d60-4310-9c8f-8cbd7401232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:02.208271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b44db-7d60-4310-9c8f-8cbd7401232c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:02.208561 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b44db-7d60-4310-9c8f-8cbd7401232c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:02.208837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b44db-7d60-4310-9c8f-8cbd7401232c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:02.211826 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:02.288808 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b44db-7d60-4310-9c8f-8cbd7401232c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:02.290301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b44db-7d60-4310-9c8f-8cbd7401232c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:02.390276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 578/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:14:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:14:02.396914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35b1e1-c879-44dd-ac18-1d1f56565b7f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:02.420198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:02.504313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35b1e1-c879-44dd-ac18-1d1f56565b7f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:02.539309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb4082-e6c7-4b98-81c4-2d152d5efd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:02.539942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb4082-e6c7-4b98-81c4-2d152d5efd8a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:02.540223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb4082-e6c7-4b98-81c4-2d152d5efd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:02.540500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb4082-e6c7-4b98-81c4-2d152d5efd8a None admin] PATH_INFO: `/v3/projects/37a0e9299ed6464d9227eceae5b342f0` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:02.541660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb4082-e6c7-4b98-81c4-2d152d5efd8a None admin] RBAC: Authorizing `identity:get_project(project_id=37a0e9299ed6464d9227eceae5b342f0)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:02.543076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb4082-e6c7-4b98-81c4-2d152d5efd8a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:02.544712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 567/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:14:02 2022] GET /identity/v3/projects/37a0e9299ed6464d9227eceae5b342f0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:02.550907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b44db-7d60-4310-9c8f-8cbd7401232c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:02.585354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:02.651476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b44db-7d60-4310-9c8f-8cbd7401232c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:02.684613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10f63f-4a97-47fc-bbcb-d0355ee76057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:02.685228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10f63f-4a97-47fc-bbcb-d0355ee76057 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:02.685538 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10f63f-4a97-47fc-bbcb-d0355ee76057 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:02.685816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10f63f-4a97-47fc-bbcb-d0355ee76057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:02.686565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10f63f-4a97-47fc-bbcb-d0355ee76057 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=37a0e9299ed6464d9227eceae5b342f0, user.id=86c83f7bc94b4e5ea0da2a04d0745fde) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:02.686878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10f63f-4a97-47fc-bbcb-d0355ee76057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:02.688809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10f63f-4a97-47fc-bbcb-d0355ee76057 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:02.694111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 579/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:14:02 2022] GET /identity/v3/role_assignments?user.id=86c83f7bc94b4e5ea0da2a04d0745fde&scope.project.id=37a0e9299ed6464d9227eceae5b342f0&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:14:04.860829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1a5f-9fb2-4972-8809-05b1c2770f36 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:04.861401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1a5f-9fb2-4972-8809-05b1c2770f36 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:04.861401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb1a5f-9fb2-4972-8809-05b1c2770f36 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:04.863026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 568/1147] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:14:04.869476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd365fb-a074-41fb-90a3-df224c35b15a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:04.869915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd365fb-a074-41fb-90a3-df224c35b15a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:04.870020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd365fb-a074-41fb-90a3-df224c35b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:04.888464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1cd365fb-a074-41fb-90a3-df224c35b15a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:04.889695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1cd365fb-a074-41fb-90a3-df224c35b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:04.954786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 580/1148] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:05.226861 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1a5f-9fb2-4972-8809-05b1c2770f36 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:05.329943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:05.343483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb1a5f-9fb2-4972-8809-05b1c2770f36 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:05.379528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005bfd-bc3d-4b18-b21e-b88a80fd81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:05.380168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005bfd-bc3d-4b18-b21e-b88a80fd81a7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:05.380447 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005bfd-bc3d-4b18-b21e-b88a80fd81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:05.380716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005bfd-bc3d-4b18-b21e-b88a80fd81a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:05.391731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06005bfd-bc3d-4b18-b21e-b88a80fd81a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-06005bfd-bc3d-4b18-b21e-b88a80fd81a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:14:05.396605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:14:05.397833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:14:05.398756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 569/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:14:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:14:05.403980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd365fb-a074-41fb-90a3-df224c35b15a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:05.433251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:05.513194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd365fb-a074-41fb-90a3-df224c35b15a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:05.548068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b7a5-9dc5-4220-930d-90af692b55eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:05.548676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b7a5-9dc5-4220-930d-90af692b55eb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:05.548953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b7a5-9dc5-4220-930d-90af692b55eb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:05.549219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b7a5-9dc5-4220-930d-90af692b55eb None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:05.549905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b7a5-9dc5-4220-930d-90af692b55eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:05.550206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b7a5-9dc5-4220-930d-90af692b55eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:05.551565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b7a5-9dc5-4220-930d-90af692b55eb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:05.559629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 581/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:14:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:05.565779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005bfd-bc3d-4b18-b21e-b88a80fd81a7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:05.668349 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005bfd-bc3d-4b18-b21e-b88a80fd81a7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:05.703420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273de254-83ba-448d-98c8-f6f536ed8561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:05.704053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273de254-83ba-448d-98c8-f6f536ed8561 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:05.704333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273de254-83ba-448d-98c8-f6f536ed8561 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:05.704604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273de254-83ba-448d-98c8-f6f536ed8561 None admin] PATH_INFO: `/v3/users/86c83f7bc94b4e5ea0da2a04d0745fde` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:05.705760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273de254-83ba-448d-98c8-f6f536ed8561 None admin] RBAC: Authorizing `identity:get_user(user_id=86c83f7bc94b4e5ea0da2a04d0745fde)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:05.707190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273de254-83ba-448d-98c8-f6f536ed8561 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:05.708763 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 570/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:14:05 2022] GET /identity/v3/users/86c83f7bc94b4e5ea0da2a04d0745fde => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:05.714831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b7a5-9dc5-4220-930d-90af692b55eb None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:05.812513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:05.822035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b7a5-9dc5-4220-930d-90af692b55eb None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:05.855289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f35f9b-78cd-4c42-8d7d-75f328d482aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:05.855915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f35f9b-78cd-4c42-8d7d-75f328d482aa None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:05.856191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f35f9b-78cd-4c42-8d7d-75f328d482aa None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:05.856462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f35f9b-78cd-4c42-8d7d-75f328d482aa None admin] PATH_INFO: `/v3/projects/37a0e9299ed6464d9227eceae5b342f0` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:05.857607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f35f9b-78cd-4c42-8d7d-75f328d482aa None admin] RBAC: Authorizing `identity:get_project(project_id=37a0e9299ed6464d9227eceae5b342f0)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:05.859106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f35f9b-78cd-4c42-8d7d-75f328d482aa None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:05.861364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 582/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:14:05 2022] GET /identity/v3/projects/37a0e9299ed6464d9227eceae5b342f0 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:05.867619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273de254-83ba-448d-98c8-f6f536ed8561 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:05.886672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:05.972954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273de254-83ba-448d-98c8-f6f536ed8561 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:06.008009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ed5ad-4782-44c3-93ff-17173e875d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:06.008685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ed5ad-4782-44c3-93ff-17173e875d73 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:06.008969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ed5ad-4782-44c3-93ff-17173e875d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:06.009278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ed5ad-4782-44c3-93ff-17173e875d73 None admin] PATH_INFO: `/v3/projects/37a0e9299ed6464d9227eceae5b342f0/users/86c83f7bc94b4e5ea0da2a04d0745fde/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:06.011226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ed5ad-4782-44c3-93ff-17173e875d73 None admin] RBAC: Authorizing `identity:create_grant(project_id=37a0e9299ed6464d9227eceae5b342f0, user_id=86c83f7bc94b4e5ea0da2a04d0745fde, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:06.012661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ed5ad-4782-44c3-93ff-17173e875d73 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:06.029661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 571/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:14:05 2022] PUT /identity/v3/projects/37a0e9299ed6464d9227eceae5b342f0/users/86c83f7bc94b4e5ea0da2a04d0745fde/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:14:08.264256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e4b35-8f47-4cb0-bb81-42440710823f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:08.264787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e4b35-8f47-4cb0-bb81-42440710823f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:08.264787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e4b35-8f47-4cb0-bb81-42440710823f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:08.266237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 583/1154] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:14:08.271690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3f72-9c75-4bf9-8ef6-48dab8642985 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:08.272118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3f72-9c75-4bf9-8ef6-48dab8642985 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:08.272254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3f72-9c75-4bf9-8ef6-48dab8642985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:08.290375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-c57c3f72-9c75-4bf9-8ef6-48dab8642985 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:08.291602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c57c3f72-9c75-4bf9-8ef6-48dab8642985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:08.358633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 572/1155] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:08.634861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e4b35-8f47-4cb0-bb81-42440710823f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:08.746017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e4b35-8f47-4cb0-bb81-42440710823f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:08.785638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2be2d-0224-400e-8255-eddf43108cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:08.786296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2be2d-0224-400e-8255-eddf43108cef None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:08.786578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2be2d-0224-400e-8255-eddf43108cef None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:08.786851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2be2d-0224-400e-8255-eddf43108cef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:08.799055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2be2d-0224-400e-8255-eddf43108cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-6ff2be2d-0224-400e-8255-eddf43108cef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:14:08.803936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:14:08.804891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:14:08.805878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 584/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:14:08.811786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3f72-9c75-4bf9-8ef6-48dab8642985 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:08.820337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:08.930267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3f72-9c75-4bf9-8ef6-48dab8642985 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:08.963738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404dc4f-80e3-4181-90bd-cb180bc0923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:08.964337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404dc4f-80e3-4181-90bd-cb180bc0923f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:08.964620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404dc4f-80e3-4181-90bd-cb180bc0923f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:08.964897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404dc4f-80e3-4181-90bd-cb180bc0923f None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:08.965834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404dc4f-80e3-4181-90bd-cb180bc0923f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:08.966148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404dc4f-80e3-4181-90bd-cb180bc0923f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:08.967514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404dc4f-80e3-4181-90bd-cb180bc0923f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:08.976096 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 573/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:08.982031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2be2d-0224-400e-8255-eddf43108cef None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:09.001816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:09.083487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2be2d-0224-400e-8255-eddf43108cef None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:09.116859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab83c3-dde6-44e7-9808-deed10721049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:09.117516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab83c3-dde6-44e7-9808-deed10721049 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:09.117800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab83c3-dde6-44e7-9808-deed10721049 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:09.118074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab83c3-dde6-44e7-9808-deed10721049 None admin] PATH_INFO: `/v3/users/86c83f7bc94b4e5ea0da2a04d0745fde` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:09.119177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab83c3-dde6-44e7-9808-deed10721049 None admin] RBAC: Authorizing `identity:get_user(user_id=86c83f7bc94b4e5ea0da2a04d0745fde)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:09.120602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab83c3-dde6-44e7-9808-deed10721049 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:09.122199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 585/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:14:08 2022] GET /identity/v3/users/86c83f7bc94b4e5ea0da2a04d0745fde => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:09.127983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404dc4f-80e3-4181-90bd-cb180bc0923f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:09.194666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:09.229138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404dc4f-80e3-4181-90bd-cb180bc0923f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:09.262434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff3f04-8518-4d6f-8de6-ab2017faa95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:09.263047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff3f04-8518-4d6f-8de6-ab2017faa95b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:09.263331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff3f04-8518-4d6f-8de6-ab2017faa95b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:09.263605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff3f04-8518-4d6f-8de6-ab2017faa95b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:09.329992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff3f04-8518-4d6f-8de6-ab2017faa95b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:09.331435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff3f04-8518-4d6f-8de6-ab2017faa95b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:09.394208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:09.428543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 574/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:14:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:14:09.434642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab83c3-dde6-44e7-9808-deed10721049 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:09.523856 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:09.539577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab83c3-dde6-44e7-9808-deed10721049 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:09.573893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd810d76-d64a-4fd9-ad66-59c58e3c66bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:09.574630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810d76-d64a-4fd9-ad66-59c58e3c66bb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:09.574913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810d76-d64a-4fd9-ad66-59c58e3c66bb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:09.575189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810d76-d64a-4fd9-ad66-59c58e3c66bb None admin] PATH_INFO: `/v3/projects/37a0e9299ed6464d9227eceae5b342f0` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:09.576315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd810d76-d64a-4fd9-ad66-59c58e3c66bb None admin] RBAC: Authorizing `identity:get_project(project_id=37a0e9299ed6464d9227eceae5b342f0)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:09.577788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd810d76-d64a-4fd9-ad66-59c58e3c66bb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:09.579414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 586/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:14:09 2022] GET /identity/v3/projects/37a0e9299ed6464d9227eceae5b342f0 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:09.585542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff3f04-8518-4d6f-8de6-ab2017faa95b None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:09.683851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff3f04-8518-4d6f-8de6-ab2017faa95b None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:09.717879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d75683-7196-4a3a-96aa-87e8474d7386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:09.718479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d75683-7196-4a3a-96aa-87e8474d7386 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:09.719341 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d75683-7196-4a3a-96aa-87e8474d7386 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:09.719620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d75683-7196-4a3a-96aa-87e8474d7386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:09.720344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d75683-7196-4a3a-96aa-87e8474d7386 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=37a0e9299ed6464d9227eceae5b342f0, user.id=86c83f7bc94b4e5ea0da2a04d0745fde) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:09.720654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d75683-7196-4a3a-96aa-87e8474d7386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:09.722118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d75683-7196-4a3a-96aa-87e8474d7386 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:09.727757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 575/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:14:09 2022] GET /identity/v3/role_assignments?user.id=86c83f7bc94b4e5ea0da2a04d0745fde&scope.project.id=37a0e9299ed6464d9227eceae5b342f0&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:11.887019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a63bfb-cf9b-4958-ae49-88b8a2fa9130 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:11.887573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a63bfb-cf9b-4958-ae49-88b8a2fa9130 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:11.887573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a63bfb-cf9b-4958-ae49-88b8a2fa9130 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:11.889501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 587/1162] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:14:11.894956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3f8f-0bad-4bdf-8cc5-0d2e3bb5454e None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:11.895350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3f8f-0bad-4bdf-8cc5-0d2e3bb5454e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:11.895505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3f8f-0bad-4bdf-8cc5-0d2e3bb5454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:11.913392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-b51e3f8f-0bad-4bdf-8cc5-0d2e3bb5454e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:11.914570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b51e3f8f-0bad-4bdf-8cc5-0d2e3bb5454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:11.940612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:11.981019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 576/1163] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:12.253341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a63bfb-cf9b-4958-ae49-88b8a2fa9130 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:12.352890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a63bfb-cf9b-4958-ae49-88b8a2fa9130 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:12.385552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a45320-d2e9-47e3-813f-cbba46c11cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:12.386166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a45320-d2e9-47e3-813f-cbba46c11cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:12.386450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a45320-d2e9-47e3-813f-cbba46c11cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:12.386729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a45320-d2e9-47e3-813f-cbba46c11cf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:12.410074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:12.454150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a45320-d2e9-47e3-813f-cbba46c11cf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:12.455641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a45320-d2e9-47e3-813f-cbba46c11cf1 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:12.563133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 588/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:14:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:14:12.568969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e3f8f-0bad-4bdf-8cc5-0d2e3bb5454e None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:12.673992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e3f8f-0bad-4bdf-8cc5-0d2e3bb5454e None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:12.708917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c81c6-47af-46f5-a7cc-15f95b2a5555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:12.709593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c81c6-47af-46f5-a7cc-15f95b2a5555 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:12.709878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c81c6-47af-46f5-a7cc-15f95b2a5555 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:12.710155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c81c6-47af-46f5-a7cc-15f95b2a5555 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:12.716900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c81c6-47af-46f5-a7cc-15f95b2a5555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:12.718366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c81c6-47af-46f5-a7cc-15f95b2a5555 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-db2c81c6-47af-46f5-a7cc-15f95b2a5555 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:14:12.729655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:14:12.730845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:14:12.731712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 577/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:14:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:14:12.737388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a45320-d2e9-47e3-813f-cbba46c11cf1 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:12.791729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:12.842902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a45320-d2e9-47e3-813f-cbba46c11cf1 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:12.877476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ce653-91ab-4707-972d-4af24e1029b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:12.878096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce653-91ab-4707-972d-4af24e1029b5 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:12.878382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce653-91ab-4707-972d-4af24e1029b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:12.878660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce653-91ab-4707-972d-4af24e1029b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:12.879308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce653-91ab-4707-972d-4af24e1029b5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:12.879617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce653-91ab-4707-972d-4af24e1029b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:12.880988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce653-91ab-4707-972d-4af24e1029b5 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:12.888264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 589/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Thu Sep 22 18:14:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:14:15.082098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2cb6c-feac-4934-baea-8fe9a7650819 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:15.082622 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2cb6c-feac-4934-baea-8fe9a7650819 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:15.082622 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2cb6c-feac-4934-baea-8fe9a7650819 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:15.083897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 578/1167] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:14:15.090506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43551dc-8507-4ea7-b8ab-80e6b51bc894 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:15.091304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43551dc-8507-4ea7-b8ab-80e6b51bc894 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:15.091424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43551dc-8507-4ea7-b8ab-80e6b51bc894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:15.112012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-a43551dc-8507-4ea7-b8ab-80e6b51bc894 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:15.113251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a43551dc-8507-4ea7-b8ab-80e6b51bc894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:15.182917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 590/1168] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:15.449586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2cb6c-feac-4934-baea-8fe9a7650819 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:15.476817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:15.556128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2cb6c-feac-4934-baea-8fe9a7650819 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:15.591231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f56ec-c376-4951-85ea-659ce130fb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:15.591847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f56ec-c376-4951-85ea-659ce130fb83 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:15.592128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f56ec-c376-4951-85ea-659ce130fb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:15.592400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f56ec-c376-4951-85ea-659ce130fb83 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:15.593073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f56ec-c376-4951-85ea-659ce130fb83 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:15.595095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f56ec-c376-4951-85ea-659ce130fb83 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:15.611947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 579/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Thu Sep 22 18:14:15 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:14:17.800600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dc8a6-24ce-4823-ad2c-853976b9f8e6 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:17.801179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dc8a6-24ce-4823-ad2c-853976b9f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:17.801179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dc8a6-24ce-4823-ad2c-853976b9f8e6 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:17.802534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 591/1170] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:14:17.808465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c8abc-e84b-48f9-a36b-d85fc8291e71 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:17.808984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c8abc-e84b-48f9-a36b-d85fc8291e71 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:17.809452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c8abc-e84b-48f9-a36b-d85fc8291e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:17.839094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-524c8abc-e84b-48f9-a36b-d85fc8291e71 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:17.841491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-524c8abc-e84b-48f9-a36b-d85fc8291e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:17.928188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 580/1171] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:18.196105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dc8a6-24ce-4823-ad2c-853976b9f8e6 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:18.252475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:18.306212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dc8a6-24ce-4823-ad2c-853976b9f8e6 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:18.340433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e374e-b4ff-4d9a-b1a2-4728dcb62905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:18.341366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e374e-b4ff-4d9a-b1a2-4728dcb62905 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:18.341648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e374e-b4ff-4d9a-b1a2-4728dcb62905 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:18.341920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e374e-b4ff-4d9a-b1a2-4728dcb62905 None admin] PATH_INFO: `/v3/domains/689c3ae5b55a410c9221716f941e46cb` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:18.353891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e374e-b4ff-4d9a-b1a2-4728dcb62905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=689c3ae5b55a410c9221716f941e46cb)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:18.355371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e374e-b4ff-4d9a-b1a2-4728dcb62905 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:18.357080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 592/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Thu Sep 22 18:14:18 2022] GET /identity/v3/domains/689c3ae5b55a410c9221716f941e46cb => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:18.363782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c8abc-e84b-48f9-a36b-d85fc8291e71 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:18.379758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:18.471516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c8abc-e84b-48f9-a36b-d85fc8291e71 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:18.510023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49595368-7fda-46de-9b10-570dd7dc3597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:18.510650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49595368-7fda-46de-9b10-570dd7dc3597 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:18.510933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49595368-7fda-46de-9b10-570dd7dc3597 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:18.511209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49595368-7fda-46de-9b10-570dd7dc3597 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:18.511884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49595368-7fda-46de-9b10-570dd7dc3597 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:18.513385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49595368-7fda-46de-9b10-570dd7dc3597 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:18.543445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 581/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:14:18 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:14:20.775969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed7444-3c20-4b5d-b417-7a9babf383d3 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:20.776518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed7444-3c20-4b5d-b417-7a9babf383d3 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:20.776518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed7444-3c20-4b5d-b417-7a9babf383d3 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:20.777891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 593/1174] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:14:20.783298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5af7ab-5053-475a-9e81-b9c00d7a3568 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:20.783689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5af7ab-5053-475a-9e81-b9c00d7a3568 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:20.783852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5af7ab-5053-475a-9e81-b9c00d7a3568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:20.801752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3a5af7ab-5053-475a-9e81-b9c00d7a3568 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:20.802949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3a5af7ab-5053-475a-9e81-b9c00d7a3568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:20.860952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:20.870405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 582/1175] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:21.147665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed7444-3c20-4b5d-b417-7a9babf383d3 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:21.264737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed7444-3c20-4b5d-b417-7a9babf383d3 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:21.274261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:21.300567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cf549-327b-4730-b8bf-d005494e600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:21.301206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cf549-327b-4730-b8bf-d005494e600a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:21.301519 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cf549-327b-4730-b8bf-d005494e600a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:21.301798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cf549-327b-4730-b8bf-d005494e600a None admin] PATH_INFO: `/v3/domains/689c3ae5b55a410c9221716f941e46cb` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:21.302904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cf549-327b-4730-b8bf-d005494e600a None admin] RBAC: Authorizing `identity:get_domain(domain_id=689c3ae5b55a410c9221716f941e46cb)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:21.304332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cf549-327b-4730-b8bf-d005494e600a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:21.305934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 594/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Thu Sep 22 18:14:21 2022] GET /identity/v3/domains/689c3ae5b55a410c9221716f941e46cb => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:21.311702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5af7ab-5053-475a-9e81-b9c00d7a3568 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:21.414430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5af7ab-5053-475a-9e81-b9c00d7a3568 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:21.447904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c260769-a4c7-47ae-9ea2-2363210aa206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:21.448510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c260769-a4c7-47ae-9ea2-2363210aa206 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:21.448791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c260769-a4c7-47ae-9ea2-2363210aa206 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:21.449066 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c260769-a4c7-47ae-9ea2-2363210aa206 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:21.449748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c260769-a4c7-47ae-9ea2-2363210aa206 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:21.451179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c260769-a4c7-47ae-9ea2-2363210aa206 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:21.473298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 583/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:14:21 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:14:23.700206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccabb0-18a4-4551-8b7b-5242ae30c5dc None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:23.700719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccabb0-18a4-4551-8b7b-5242ae30c5dc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:23.700719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccabb0-18a4-4551-8b7b-5242ae30c5dc None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:23.702116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 595/1178] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:14:23.708059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e41496-0480-4781-a287-3e66cd972c79 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:23.708470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e41496-0480-4781-a287-3e66cd972c79 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:23.708609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e41496-0480-4781-a287-3e66cd972c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:23.726726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-f0e41496-0480-4781-a287-3e66cd972c79 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:23.727916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f0e41496-0480-4781-a287-3e66cd972c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:23.772834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:23.793984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 584/1179] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:24.071996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccabb0-18a4-4551-8b7b-5242ae30c5dc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:24.171036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccabb0-18a4-4551-8b7b-5242ae30c5dc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:24.205022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4e6da-a3fc-4701-93ec-a371c2be01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:24.205709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4e6da-a3fc-4701-93ec-a371c2be01c1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:24.205997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4e6da-a3fc-4701-93ec-a371c2be01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:24.206283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4e6da-a3fc-4701-93ec-a371c2be01c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:24.217457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4e6da-a3fc-4701-93ec-a371c2be01c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-d5b4e6da-a3fc-4701-93ec-a371c2be01c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:14:24.223329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:14:24.224513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:14:24.225631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 596/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:14:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:14:24.230652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e41496-0480-4781-a287-3e66cd972c79 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:24.330012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e41496-0480-4781-a287-3e66cd972c79 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:24.362810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dbff6-26ba-4d5e-8072-117b1d2ad5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:24.363422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dbff6-26ba-4d5e-8072-117b1d2ad5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:24.363698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dbff6-26ba-4d5e-8072-117b1d2ad5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:24.363970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dbff6-26ba-4d5e-8072-117b1d2ad5c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:24.364643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dbff6-26ba-4d5e-8072-117b1d2ad5c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:24.364942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dbff6-26ba-4d5e-8072-117b1d2ad5c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:24.366360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dbff6-26ba-4d5e-8072-117b1d2ad5c2 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:24.374799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 585/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:14:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:24.381332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4e6da-a3fc-4701-93ec-a371c2be01c1 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:24.417218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:24.480955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4e6da-a3fc-4701-93ec-a371c2be01c1 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:24.513722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3838ae-5024-470b-8dcf-72d83f3e91ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:24.514343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3838ae-5024-470b-8dcf-72d83f3e91ef None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:24.514620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3838ae-5024-470b-8dcf-72d83f3e91ef None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:24.514890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3838ae-5024-470b-8dcf-72d83f3e91ef None admin] PATH_INFO: `/v3/users/a05f17528fae4e819bf93b17ca3dbd84` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:24.528174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3838ae-5024-470b-8dcf-72d83f3e91ef None admin] RBAC: Authorizing `identity:get_user(user_id=a05f17528fae4e819bf93b17ca3dbd84)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:24.529697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3838ae-5024-470b-8dcf-72d83f3e91ef None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:24.531279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 597/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:14:24 2022] GET /identity/v3/users/a05f17528fae4e819bf93b17ca3dbd84 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:24.537105 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dbff6-26ba-4d5e-8072-117b1d2ad5c2 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:24.580983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:24.638087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dbff6-26ba-4d5e-8072-117b1d2ad5c2 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:24.670855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02361520-0996-4605-a79a-857b23008ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:24.671471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02361520-0996-4605-a79a-857b23008ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:24.671753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02361520-0996-4605-a79a-857b23008ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:24.672567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02361520-0996-4605-a79a-857b23008ae6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:24.740005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02361520-0996-4605-a79a-857b23008ae6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:24.741472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02361520-0996-4605-a79a-857b23008ae6 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:24.784183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:24.841956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 586/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:14:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:14:24.848024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3838ae-5024-470b-8dcf-72d83f3e91ef None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:24.940765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:24.948728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3838ae-5024-470b-8dcf-72d83f3e91ef None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:24.987437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484438a3-b94b-4dcc-82a1-3885f8a7c3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:24.988077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484438a3-b94b-4dcc-82a1-3885f8a7c3cc None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:24.988357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484438a3-b94b-4dcc-82a1-3885f8a7c3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:24.988629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484438a3-b94b-4dcc-82a1-3885f8a7c3cc None admin] PATH_INFO: `/v3/projects/09e8d44de27346e0a753afbcc0eefcab` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:24.989769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484438a3-b94b-4dcc-82a1-3885f8a7c3cc None admin] RBAC: Authorizing `identity:get_project(project_id=09e8d44de27346e0a753afbcc0eefcab)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:24.991202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484438a3-b94b-4dcc-82a1-3885f8a7c3cc None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:24.992833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 598/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:14:24 2022] GET /identity/v3/projects/09e8d44de27346e0a753afbcc0eefcab => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:24.999205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02361520-0996-4605-a79a-857b23008ae6 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:25.101045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02361520-0996-4605-a79a-857b23008ae6 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:25.134594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baec58-c3d9-4ff8-8096-b5982bf89d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:25.135199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baec58-c3d9-4ff8-8096-b5982bf89d24 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:25.135477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baec58-c3d9-4ff8-8096-b5982bf89d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:25.135753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baec58-c3d9-4ff8-8096-b5982bf89d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:25.136486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baec58-c3d9-4ff8-8096-b5982bf89d24 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=09e8d44de27346e0a753afbcc0eefcab, user.id=a05f17528fae4e819bf93b17ca3dbd84) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:25.136796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baec58-c3d9-4ff8-8096-b5982bf89d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:25.138241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baec58-c3d9-4ff8-8096-b5982bf89d24 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:25.143599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 587/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:14:24 2022] GET /identity/v3/role_assignments?user.id=a05f17528fae4e819bf93b17ca3dbd84&scope.project.id=09e8d44de27346e0a753afbcc0eefcab&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:27.270161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4eaf1-3bd9-42e8-8eee-29fc495e877c None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:27.270721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4eaf1-3bd9-42e8-8eee-29fc495e877c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:27.270721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4eaf1-3bd9-42e8-8eee-29fc495e877c None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:27.272067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 599/1186] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:14:27.277544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3669d-997c-470a-bbde-9fc4d2ab1e0b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:27.277992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3669d-997c-470a-bbde-9fc4d2ab1e0b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:27.278105 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3669d-997c-470a-bbde-9fc4d2ab1e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:27.291448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:27.298099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-54f3669d-997c-470a-bbde-9fc4d2ab1e0b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:27.299290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-54f3669d-997c-470a-bbde-9fc4d2ab1e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:27.366997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 588/1187] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:27.645369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4eaf1-3bd9-42e8-8eee-29fc495e877c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:27.748330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4eaf1-3bd9-42e8-8eee-29fc495e877c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:27.781435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b444e-c033-436a-b2a7-e927fc70cc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:27.782065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b444e-c033-436a-b2a7-e927fc70cc32 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:27.782345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b444e-c033-436a-b2a7-e927fc70cc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:27.782618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b444e-c033-436a-b2a7-e927fc70cc32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:27.792414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b444e-c033-436a-b2a7-e927fc70cc32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-bd1b444e-c033-436a-b2a7-e927fc70cc32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:14:27.797746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:14:27.799036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:14:27.800310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 600/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:14:27.804924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3669d-997c-470a-bbde-9fc4d2ab1e0b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:27.902684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3669d-997c-470a-bbde-9fc4d2ab1e0b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:27.942386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a01de-a126-4c89-b066-4aca37b79917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:27.943007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a01de-a126-4c89-b066-4aca37b79917 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:27.943294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a01de-a126-4c89-b066-4aca37b79917 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:27.943563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a01de-a126-4c89-b066-4aca37b79917 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:27.944225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a01de-a126-4c89-b066-4aca37b79917 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:27.944529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a01de-a126-4c89-b066-4aca37b79917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:27.945917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a01de-a126-4c89-b066-4aca37b79917 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:27.948072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:27.954984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 589/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:14:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:27.960579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b444e-c033-436a-b2a7-e927fc70cc32 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:27.986024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:28.061471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b444e-c033-436a-b2a7-e927fc70cc32 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:28.095919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681f82-2204-4208-a540-0dd8bf3c03a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:28.096543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681f82-2204-4208-a540-0dd8bf3c03a6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:28.096831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681f82-2204-4208-a540-0dd8bf3c03a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:28.097106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681f82-2204-4208-a540-0dd8bf3c03a6 None admin] PATH_INFO: `/v3/users/a05f17528fae4e819bf93b17ca3dbd84` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:28.098252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b681f82-2204-4208-a540-0dd8bf3c03a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a05f17528fae4e819bf93b17ca3dbd84)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:28.099675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b681f82-2204-4208-a540-0dd8bf3c03a6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:28.101257 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 601/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:14:27 2022] GET /identity/v3/users/a05f17528fae4e819bf93b17ca3dbd84 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:14:28.107133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a01de-a126-4c89-b066-4aca37b79917 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:28.205885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a01de-a126-4c89-b066-4aca37b79917 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:28.238760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b64fa-8705-450c-b0a1-b3e741f38497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:28.239383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b64fa-8705-450c-b0a1-b3e741f38497 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:28.239666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b64fa-8705-450c-b0a1-b3e741f38497 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:28.239941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b64fa-8705-450c-b0a1-b3e741f38497 None admin] PATH_INFO: `/v3/projects/09e8d44de27346e0a753afbcc0eefcab` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:28.241044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b64fa-8705-450c-b0a1-b3e741f38497 None admin] RBAC: Authorizing `identity:get_project(project_id=09e8d44de27346e0a753afbcc0eefcab)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:28.242517 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b64fa-8705-450c-b0a1-b3e741f38497 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:28.244136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 590/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:14:28 2022] GET /identity/v3/projects/09e8d44de27346e0a753afbcc0eefcab => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:14:28.250725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681f82-2204-4208-a540-0dd8bf3c03a6 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:28.338140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:28.348198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681f82-2204-4208-a540-0dd8bf3c03a6 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:28.381545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37caa8c-dbca-4a74-8400-ac494c623c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:28.382197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37caa8c-dbca-4a74-8400-ac494c623c02 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:28.382473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37caa8c-dbca-4a74-8400-ac494c623c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:28.382742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37caa8c-dbca-4a74-8400-ac494c623c02 None admin] PATH_INFO: `/v3/projects/09e8d44de27346e0a753afbcc0eefcab/users/a05f17528fae4e819bf93b17ca3dbd84/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:28.384596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37caa8c-dbca-4a74-8400-ac494c623c02 None admin] RBAC: Authorizing `identity:create_grant(project_id=09e8d44de27346e0a753afbcc0eefcab, user_id=a05f17528fae4e819bf93b17ca3dbd84, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:28.386034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37caa8c-dbca-4a74-8400-ac494c623c02 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:28.398219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 602/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:14:28 2022] PUT /identity/v3/projects/09e8d44de27346e0a753afbcc0eefcab/users/a05f17528fae4e819bf93b17ca3dbd84/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:14:30.515675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc804b1-f450-480b-9496-9f78a760d4b7 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:30.516244 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc804b1-f450-480b-9496-9f78a760d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:30.516347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc804b1-f450-480b-9496-9f78a760d4b7 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:30.517909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 591/1193] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:14:30.523064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60a59-9933-4f4f-9864-436726c461b1 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:30.523448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60a59-9933-4f4f-9864-436726c461b1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:30.523615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60a59-9933-4f4f-9864-436726c461b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:30.542574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-05a60a59-9933-4f4f-9864-436726c461b1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:14:30.543777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-05a60a59-9933-4f4f-9864-436726c461b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:14:30.610506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 603/1194] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:14:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:14:30.879511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc804b1-f450-480b-9496-9f78a760d4b7 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:30.945281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:30.984354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc804b1-f450-480b-9496-9f78a760d4b7 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:31.022615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8e904-646e-4f29-b971-85c85fb8f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:31.023285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8e904-646e-4f29-b971-85c85fb8f755 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:31.023597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8e904-646e-4f29-b971-85c85fb8f755 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:31.023896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8e904-646e-4f29-b971-85c85fb8f755 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:31.035209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8e904-646e-4f29-b971-85c85fb8f755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-eec8e904-646e-4f29-b971-85c85fb8f755 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:14:31.040512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:14:31.041734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:14:31.042836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 592/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:14:31.047776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a60a59-9933-4f4f-9864-436726c461b1 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:31.124690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:31.147681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a60a59-9933-4f4f-9864-436726c461b1 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:31.183548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c18b3-345f-4cf2-a30f-389d9757609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:31.184162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c18b3-345f-4cf2-a30f-389d9757609b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:31.184446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c18b3-345f-4cf2-a30f-389d9757609b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:31.184724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c18b3-345f-4cf2-a30f-389d9757609b None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:31.185415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c18b3-345f-4cf2-a30f-389d9757609b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:31.185725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c18b3-345f-4cf2-a30f-389d9757609b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:31.187123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c18b3-345f-4cf2-a30f-389d9757609b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:31.197119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 604/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:14:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:31.203294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8e904-646e-4f29-b971-85c85fb8f755 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:31.315110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8e904-646e-4f29-b971-85c85fb8f755 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:31.341623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:31.350953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880f264-5da9-437e-a992-77f63c8cad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:31.351579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880f264-5da9-437e-a992-77f63c8cad7f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:31.351861 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880f264-5da9-437e-a992-77f63c8cad7f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:31.352134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880f264-5da9-437e-a992-77f63c8cad7f None admin] PATH_INFO: `/v3/users/a05f17528fae4e819bf93b17ca3dbd84` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:31.353277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880f264-5da9-437e-a992-77f63c8cad7f None admin] RBAC: Authorizing `identity:get_user(user_id=a05f17528fae4e819bf93b17ca3dbd84)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:31.354688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880f264-5da9-437e-a992-77f63c8cad7f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:31.356257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 593/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Thu Sep 22 18:14:31 2022] GET /identity/v3/users/a05f17528fae4e819bf93b17ca3dbd84 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:31.362785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c18b3-345f-4cf2-a30f-389d9757609b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:31.459763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c18b3-345f-4cf2-a30f-389d9757609b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:31.492474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59b3ba-2753-4193-954b-da07c6a8128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:31.493071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59b3ba-2753-4193-954b-da07c6a8128f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:31.493380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59b3ba-2753-4193-954b-da07c6a8128f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:31.493654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59b3ba-2753-4193-954b-da07c6a8128f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:31.504995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:31.561556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59b3ba-2753-4193-954b-da07c6a8128f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:31.562202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59b3ba-2753-4193-954b-da07c6a8128f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:31.668619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 605/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:14:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:14:31.674585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880f264-5da9-437e-a992-77f63c8cad7f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:31.775491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880f264-5da9-437e-a992-77f63c8cad7f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:31.808983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399cc53-f341-4031-b78c-fd73b2f6503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:31.809644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399cc53-f341-4031-b78c-fd73b2f6503a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:31.809926 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399cc53-f341-4031-b78c-fd73b2f6503a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:31.810199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399cc53-f341-4031-b78c-fd73b2f6503a None admin] PATH_INFO: `/v3/projects/09e8d44de27346e0a753afbcc0eefcab` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:31.811306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399cc53-f341-4031-b78c-fd73b2f6503a None admin] RBAC: Authorizing `identity:get_project(project_id=09e8d44de27346e0a753afbcc0eefcab)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:31.813298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399cc53-f341-4031-b78c-fd73b2f6503a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:31.814897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 594/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Thu Sep 22 18:14:31 2022] GET /identity/v3/projects/09e8d44de27346e0a753afbcc0eefcab => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:31.821505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59b3ba-2753-4193-954b-da07c6a8128f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:14:31.864350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:31.920419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59b3ba-2753-4193-954b-da07c6a8128f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:14:31.954230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e54a6-99c5-420a-8184-48e993592dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:14:31.954828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e54a6-99c5-420a-8184-48e993592dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:14:31.955103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e54a6-99c5-420a-8184-48e993592dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:14:31.955367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e54a6-99c5-420a-8184-48e993592dc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:14:31.956080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e54a6-99c5-420a-8184-48e993592dc2 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=09e8d44de27346e0a753afbcc0eefcab, user.id=a05f17528fae4e819bf93b17ca3dbd84) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:14:31.956385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e54a6-99c5-420a-8184-48e993592dc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:14:31.957828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e54a6-99c5-420a-8184-48e993592dc2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:14:31.963507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 606/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:14:31 2022] GET /identity/v3/role_assignments?user.id=a05f17528fae4e819bf93b17ca3dbd84&scope.project.id=09e8d44de27346e0a753afbcc0eefcab&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:14:41.804737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=69 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:14:41.960988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=47 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:27.756994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82194a1-7ae6-46f0-adb8-9269819e5ce3 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:27.756994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82194a1-7ae6-46f0-adb8-9269819e5ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:27.756994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82194a1-7ae6-46f0-adb8-9269819e5ce3 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:27.756994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 595/1201] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:15:27.764015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a171d-90d6-4a6b-9e7c-26e5e2cfca28 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:27.764562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a171d-90d6-4a6b-9e7c-26e5e2cfca28 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:27.764562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a171d-90d6-4a6b-9e7c-26e5e2cfca28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:27.787505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-969a171d-90d6-4a6b-9e7c-26e5e2cfca28 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:15:27.788802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-969a171d-90d6-4a6b-9e7c-26e5e2cfca28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:15:27.887259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 607/1202] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:15:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:15:28.169489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82194a1-7ae6-46f0-adb8-9269819e5ce3 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:28.319985 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82194a1-7ae6-46f0-adb8-9269819e5ce3 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:28.365759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6806e2e-fe2c-4a86-8369-00655a20ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:28.366507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806e2e-fe2c-4a86-8369-00655a20ceb7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:28.366765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806e2e-fe2c-4a86-8369-00655a20ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:28.367047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806e2e-fe2c-4a86-8369-00655a20ceb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:28.384246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6806e2e-fe2c-4a86-8369-00655a20ceb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:28.386014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6806e2e-fe2c-4a86-8369-00655a20ceb7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-c6806e2e-fe2c-4a86-8369-00655a20ceb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:28.408193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:28.409558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:28.410551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:28.410551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:28.410551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:28.410551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 596/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:28.421024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a171d-90d6-4a6b-9e7c-26e5e2cfca28 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:28.593935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a171d-90d6-4a6b-9e7c-26e5e2cfca28 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:28.652612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:28.678742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574ea71-737e-49e7-a2cf-0cee2991a9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:28.679960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ea71-737e-49e7-a2cf-0cee2991a9bf None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:28.680235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ea71-737e-49e7-a2cf-0cee2991a9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:28.680747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ea71-737e-49e7-a2cf-0cee2991a9bf None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:28.682020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574ea71-737e-49e7-a2cf-0cee2991a9bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:28.682541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574ea71-737e-49e7-a2cf-0cee2991a9bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:28.687119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574ea71-737e-49e7-a2cf-0cee2991a9bf None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:28.700435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 608/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:15:28.706614 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6806e2e-fe2c-4a86-8369-00655a20ceb7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:28.780737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:28.857342 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6806e2e-fe2c-4a86-8369-00655a20ceb7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:28.900782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0ae56-e12c-4748-97cc-9613bf06ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:28.901496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0ae56-e12c-4748-97cc-9613bf06ca73 None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:28.901797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0ae56-e12c-4748-97cc-9613bf06ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:28.902136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0ae56-e12c-4748-97cc-9613bf06ca73 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:28.902931 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0ae56-e12c-4748-97cc-9613bf06ca73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:28.904644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0ae56-e12c-4748-97cc-9613bf06ca73 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:28.934107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 597/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Thu Sep 22 18:15:28 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:15:31.282749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba5abe-a45a-464f-81eb-7ebc91233b96 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:31.283342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba5abe-a45a-464f-81eb-7ebc91233b96 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:31.283342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba5abe-a45a-464f-81eb-7ebc91233b96 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:31.284660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 609/1206] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:15:31.290582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585539-d3be-40a2-9d9e-fc6aa5104ddc None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:31.291167 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585539-d3be-40a2-9d9e-fc6aa5104ddc None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:31.291167 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585539-d3be-40a2-9d9e-fc6aa5104ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:31.311288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-42585539-d3be-40a2-9d9e-fc6aa5104ddc None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:15:31.312434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-42585539-d3be-40a2-9d9e-fc6aa5104ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:15:31.395628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 598/1207] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:15:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:15:31.663994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba5abe-a45a-464f-81eb-7ebc91233b96 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:31.795920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba5abe-a45a-464f-81eb-7ebc91233b96 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:31.840302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460c71e-95bc-45db-9d0b-ba31c38bc9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:31.841151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460c71e-95bc-45db-9d0b-ba31c38bc9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:31.841445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460c71e-95bc-45db-9d0b-ba31c38bc9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:31.841798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460c71e-95bc-45db-9d0b-ba31c38bc9a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:31.855326 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460c71e-95bc-45db-9d0b-ba31c38bc9a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-4460c71e-95bc-45db-9d0b-ba31c38bc9a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:15:31.860383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:31.862895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:15:31.864075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:31.866666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 610/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:31.867939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585539-d3be-40a2-9d9e-fc6aa5104ddc None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:31.923533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:31.992724 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585539-d3be-40a2-9d9e-fc6aa5104ddc None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:32.031170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97b7f-4eed-47fb-ae67-d1ea497829d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:32.031960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97b7f-4eed-47fb-ae67-d1ea497829d3 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:32.032336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97b7f-4eed-47fb-ae67-d1ea497829d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:32.032745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97b7f-4eed-47fb-ae67-d1ea497829d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:32.033560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97b7f-4eed-47fb-ae67-d1ea497829d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:32.034014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97b7f-4eed-47fb-ae67-d1ea497829d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:32.035712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97b7f-4eed-47fb-ae67-d1ea497829d3 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:32.046332 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 599/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:15:32.052724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460c71e-95bc-45db-9d0b-ba31c38bc9a4 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:32.107847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:32.175944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460c71e-95bc-45db-9d0b-ba31c38bc9a4 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:32.219140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741e77b-f6b7-4ee1-ba75-3143856c6ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:32.220399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741e77b-f6b7-4ee1-ba75-3143856c6ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:32.220853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741e77b-f6b7-4ee1-ba75-3143856c6ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:32.221299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741e77b-f6b7-4ee1-ba75-3143856c6ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:32.232892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741e77b-f6b7-4ee1-ba75-3143856c6ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:32.234404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741e77b-f6b7-4ee1-ba75-3143856c6ff0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-7741e77b-f6b7-4ee1-ba75-3143856c6ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:32.250237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:32.252012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:32.252951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:32.252951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:32.252951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:32.258230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 611/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:32.258416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97b7f-4eed-47fb-ae67-d1ea497829d3 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:32.376934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:32.381665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97b7f-4eed-47fb-ae67-d1ea497829d3 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:32.429750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44683f5-b4b9-4535-a2f3-37947526592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:32.430269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44683f5-b4b9-4535-a2f3-37947526592d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:32.430558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44683f5-b4b9-4535-a2f3-37947526592d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:32.430833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44683f5-b4b9-4535-a2f3-37947526592d None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:32.431484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44683f5-b4b9-4535-a2f3-37947526592d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:32.431793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44683f5-b4b9-4535-a2f3-37947526592d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:32.433201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44683f5-b4b9-4535-a2f3-37947526592d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:32.446933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 600/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:15:32.452726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741e77b-f6b7-4ee1-ba75-3143856c6ff0 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:32.575836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741e77b-f6b7-4ee1-ba75-3143856c6ff0 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:32.577483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:32.615304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade40bd-1eb2-456e-8f83-c51d863ceac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:32.616014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade40bd-1eb2-456e-8f83-c51d863ceac1 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:32.616392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade40bd-1eb2-456e-8f83-c51d863ceac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:32.616711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade40bd-1eb2-456e-8f83-c51d863ceac1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:32.625353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade40bd-1eb2-456e-8f83-c51d863ceac1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:32.627642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade40bd-1eb2-456e-8f83-c51d863ceac1 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-3ade40bd-1eb2-456e-8f83-c51d863ceac1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:15:32.640413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:32.648223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:32.649186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 612/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:32.650546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44683f5-b4b9-4535-a2f3-37947526592d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:32.783871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44683f5-b4b9-4535-a2f3-37947526592d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:32.823398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f997bcf-d941-4098-8d23-45d87b695f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:32.824364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f997bcf-d941-4098-8d23-45d87b695f67 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:32.824711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f997bcf-d941-4098-8d23-45d87b695f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:32.825090 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f997bcf-d941-4098-8d23-45d87b695f67 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:32.825906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f997bcf-d941-4098-8d23-45d87b695f67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:32.826268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f997bcf-d941-4098-8d23-45d87b695f67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:32.827907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f997bcf-d941-4098-8d23-45d87b695f67 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:32.848978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 601/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Thu Sep 22 18:15:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:32.855070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade40bd-1eb2-456e-8f83-c51d863ceac1 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:32.985427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade40bd-1eb2-456e-8f83-c51d863ceac1 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:33.026073 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496b44-5a01-4bd3-9729-e9c13b04d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:33.026731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496b44-5a01-4bd3-9729-e9c13b04d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:33.027009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496b44-5a01-4bd3-9729-e9c13b04d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:33.027278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496b44-5a01-4bd3-9729-e9c13b04d3d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:33.071304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:33.122219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb496b44-5a01-4bd3-9729-e9c13b04d3d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:33.123683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb496b44-5a01-4bd3-9729-e9c13b04d3d8 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:33.234369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 613/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:15:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 18:15:33.240639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f997bcf-d941-4098-8d23-45d87b695f67 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:33.263604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:33.363149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f997bcf-d941-4098-8d23-45d87b695f67 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:33.409567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e2757-d93f-4852-abad-9c70f5f9aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:33.410239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e2757-d93f-4852-abad-9c70f5f9aca6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:33.410530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e2757-d93f-4852-abad-9c70f5f9aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:33.410865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e2757-d93f-4852-abad-9c70f5f9aca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:33.423350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e2757-d93f-4852-abad-9c70f5f9aca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:33.425206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e2757-d93f-4852-abad-9c70f5f9aca6 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-097e2757-d93f-4852-abad-9c70f5f9aca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:33.444427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:33.445504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:33.451467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:33.451467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:33.451467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:33.451467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 602/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:33.451710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496b44-5a01-4bd3-9729-e9c13b04d3d8 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:33.532397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:33.585793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496b44-5a01-4bd3-9729-e9c13b04d3d8 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:33.632618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948959-f4ab-4262-a525-8c6677c26b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:33.633569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948959-f4ab-4262-a525-8c6677c26b0b None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:33.634927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948959-f4ab-4262-a525-8c6677c26b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:33.635217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948959-f4ab-4262-a525-8c6677c26b0b None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:33.636034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5948959-f4ab-4262-a525-8c6677c26b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:33.636521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5948959-f4ab-4262-a525-8c6677c26b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:33.638347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5948959-f4ab-4262-a525-8c6677c26b0b None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:33.654681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 614/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:33.662736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e2757-d93f-4852-abad-9c70f5f9aca6 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:33.761948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:33.801403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e2757-d93f-4852-abad-9c70f5f9aca6 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:33.843014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7570e-41f0-4b25-ae8d-a0cf8e6de9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:33.843679 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7570e-41f0-4b25-ae8d-a0cf8e6de9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:33.843957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7570e-41f0-4b25-ae8d-a0cf8e6de9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:33.844227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7570e-41f0-4b25-ae8d-a0cf8e6de9e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:33.854274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7570e-41f0-4b25-ae8d-a0cf8e6de9e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:33.855807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7570e-41f0-4b25-ae8d-a0cf8e6de9e0 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-bdf7570e-41f0-4b25-ae8d-a0cf8e6de9e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:15:33.870214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:33.877063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:33.878239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:15:33.878239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:15:33.878239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:15:33.878239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:15:33.878239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:15:33.878239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:15:33.878239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:33.878239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:33.878239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 603/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:33.880410 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948959-f4ab-4262-a525-8c6677c26b0b None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:34.003614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948959-f4ab-4262-a525-8c6677c26b0b None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:34.029540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:34.043961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d932f82-0ece-47b6-b452-fcee6a8eccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:34.044660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d932f82-0ece-47b6-b452-fcee6a8eccad None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:34.044940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d932f82-0ece-47b6-b452-fcee6a8eccad None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:34.045212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d932f82-0ece-47b6-b452-fcee6a8eccad None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:34.045939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d932f82-0ece-47b6-b452-fcee6a8eccad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:34.046254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d932f82-0ece-47b6-b452-fcee6a8eccad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:34.048032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d932f82-0ece-47b6-b452-fcee6a8eccad None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:34.061458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 615/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:34.067826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7570e-41f0-4b25-ae8d-a0cf8e6de9e0 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:34.198468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7570e-41f0-4b25-ae8d-a0cf8e6de9e0 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:34.230168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:34.237124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc9676-9622-49a0-b32d-4d1db7b7c865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:34.237772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9676-9622-49a0-b32d-4d1db7b7c865 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:34.238058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9676-9622-49a0-b32d-4d1db7b7c865 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:34.238345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9676-9622-49a0-b32d-4d1db7b7c865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:34.239075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc9676-9622-49a0-b32d-4d1db7b7c865 None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=e42268a8b5944cbd9508a07c037112e3) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:34.239423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc9676-9622-49a0-b32d-4d1db7b7c865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:34.240914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc9676-9622-49a0-b32d-4d1db7b7c865 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:34.246975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 604/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:15:34 2022] GET /identity/v3/role_assignments?user.id=e42268a8b5944cbd9508a07c037112e3&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:15:36.362165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4f644-c3ef-4df6-a0c7-d00fd83c95f4 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:36.362833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4f644-c3ef-4df6-a0c7-d00fd83c95f4 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:36.362833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4f644-c3ef-4df6-a0c7-d00fd83c95f4 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:36.364349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 616/1220] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:15:36.369404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e8f6-faf1-4822-816d-9f977a40efdd None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:36.369887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e8f6-faf1-4822-816d-9f977a40efdd None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:36.370142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e8f6-faf1-4822-816d-9f977a40efdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:36.388095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-b623e8f6-faf1-4822-816d-9f977a40efdd None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:15:36.389380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b623e8f6-faf1-4822-816d-9f977a40efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:15:36.471222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 605/1221] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:15:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:15:36.756245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4f644-c3ef-4df6-a0c7-d00fd83c95f4 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:36.869478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4f644-c3ef-4df6-a0c7-d00fd83c95f4 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:36.911539 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea094a5-dda6-4a47-a210-465c5f118c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:36.912246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea094a5-dda6-4a47-a210-465c5f118c21 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:36.912578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea094a5-dda6-4a47-a210-465c5f118c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:36.912859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea094a5-dda6-4a47-a210-465c5f118c21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:36.923926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea094a5-dda6-4a47-a210-465c5f118c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-3ea094a5-dda6-4a47-a210-465c5f118c21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:15:36.929303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:36.930429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:36.931434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 617/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:15:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:15:36.936562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e8f6-faf1-4822-816d-9f977a40efdd None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:37.052272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e8f6-faf1-4822-816d-9f977a40efdd None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:37.080161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:37.092259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a974e-7541-44d8-9ea4-6bb3af4db51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:37.092886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a974e-7541-44d8-9ea4-6bb3af4db51e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:37.093152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a974e-7541-44d8-9ea4-6bb3af4db51e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:37.093457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a974e-7541-44d8-9ea4-6bb3af4db51e None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:37.094124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a974e-7541-44d8-9ea4-6bb3af4db51e None admin] RBAC: Adding query filter params (name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:37.094435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a974e-7541-44d8-9ea4-6bb3af4db51e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:37.096080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a974e-7541-44d8-9ea4-6bb3af4db51e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:37.104722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 606/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:15:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:37.111193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea094a5-dda6-4a47-a210-465c5f118c21 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:37.160711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:37.224873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea094a5-dda6-4a47-a210-465c5f118c21 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:37.267385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d49bb-57a2-476b-8389-de69cfc22ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:37.268489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d49bb-57a2-476b-8389-de69cfc22ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:37.269057 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d49bb-57a2-476b-8389-de69cfc22ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:37.269803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d49bb-57a2-476b-8389-de69cfc22ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:37.289873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d49bb-57a2-476b-8389-de69cfc22ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:37.291781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d49bb-57a2-476b-8389-de69cfc22ac2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-cd2d49bb-57a2-476b-8389-de69cfc22ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:37.307487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:37.308708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:37.309756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:37.309756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:37.309756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:37.309756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 618/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:37.314802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a974e-7541-44d8-9ea4-6bb3af4db51e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:37.430176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a974e-7541-44d8-9ea4-6bb3af4db51e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:37.467455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a825c87-45d5-48f4-8278-5d01ef5f835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:37.468074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a825c87-45d5-48f4-8278-5d01ef5f835f None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:37.468360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a825c87-45d5-48f4-8278-5d01ef5f835f None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:37.468636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a825c87-45d5-48f4-8278-5d01ef5f835f None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:37.469314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a825c87-45d5-48f4-8278-5d01ef5f835f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:37.470145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a825c87-45d5-48f4-8278-5d01ef5f835f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:37.471523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a825c87-45d5-48f4-8278-5d01ef5f835f None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:37.495486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 607/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:37.496550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d49bb-57a2-476b-8389-de69cfc22ac2 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:37.610225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:37.618399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d49bb-57a2-476b-8389-de69cfc22ac2 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:37.654792 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc188c-8ecc-4201-979a-2347ed416fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:37.655438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc188c-8ecc-4201-979a-2347ed416fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:37.655763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc188c-8ecc-4201-979a-2347ed416fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:37.655985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc188c-8ecc-4201-979a-2347ed416fb7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:37.666508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc188c-8ecc-4201-979a-2347ed416fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:37.667979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc188c-8ecc-4201-979a-2347ed416fb7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-8ecc188c-8ecc-4201-979a-2347ed416fb7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:15:37.680163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:37.681136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:37.682103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 619/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:37.687282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a825c87-45d5-48f4-8278-5d01ef5f835f None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:37.737654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:37.795097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a825c87-45d5-48f4-8278-5d01ef5f835f None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:37.830788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc973c27-1cc4-4bc1-9c83-7e41cd09516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:37.831397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc973c27-1cc4-4bc1-9c83-7e41cd09516a None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:37.831675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc973c27-1cc4-4bc1-9c83-7e41cd09516a None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:37.831943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc973c27-1cc4-4bc1-9c83-7e41cd09516a None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:37.832672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc973c27-1cc4-4bc1-9c83-7e41cd09516a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:37.832971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc973c27-1cc4-4bc1-9c83-7e41cd09516a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:37.834422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc973c27-1cc4-4bc1-9c83-7e41cd09516a None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:37.858462 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 608/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Thu Sep 22 18:15:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:37.860942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc188c-8ecc-4201-979a-2347ed416fb7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:37.969461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc188c-8ecc-4201-979a-2347ed416fb7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:38.004509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56572dab-6327-4f8c-9438-e08edb779bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:38.005147 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56572dab-6327-4f8c-9438-e08edb779bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:38.005517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56572dab-6327-4f8c-9438-e08edb779bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:38.005731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56572dab-6327-4f8c-9438-e08edb779bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:38.016476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56572dab-6327-4f8c-9438-e08edb779bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:38.018482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56572dab-6327-4f8c-9438-e08edb779bd4 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-56572dab-6327-4f8c-9438-e08edb779bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:38.033532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:38.034604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:38.035548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:38.035548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:38.035548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:38.035548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 620/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:38.040605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc973c27-1cc4-4bc1-9c83-7e41cd09516a None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:38.149661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc973c27-1cc4-4bc1-9c83-7e41cd09516a None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:38.152325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:38.189531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534570f-61d3-4f87-b68e-ca574672bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:38.190155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534570f-61d3-4f87-b68e-ca574672bc21 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:38.190489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534570f-61d3-4f87-b68e-ca574672bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:38.190811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534570f-61d3-4f87-b68e-ca574672bc21 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:38.191526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534570f-61d3-4f87-b68e-ca574672bc21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:38.191833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534570f-61d3-4f87-b68e-ca574672bc21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:38.193217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534570f-61d3-4f87-b68e-ca574672bc21 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:38.206262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 609/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:38.212203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56572dab-6327-4f8c-9438-e08edb779bd4 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:38.222870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:38.327558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56572dab-6327-4f8c-9438-e08edb779bd4 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:38.365561 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e74b9-c07a-4537-990b-d8958e9fd1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:38.366211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e74b9-c07a-4537-990b-d8958e9fd1ed None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:38.366630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e74b9-c07a-4537-990b-d8958e9fd1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:38.366965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e74b9-c07a-4537-990b-d8958e9fd1ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:38.374659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e74b9-c07a-4537-990b-d8958e9fd1ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:38.376240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e74b9-c07a-4537-990b-d8958e9fd1ed None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-b32e74b9-c07a-4537-990b-d8958e9fd1ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:15:38.391734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:38.392881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:38.393821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:15:38.393821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:15:38.393821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:15:38.393821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:15:38.393821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:15:38.393821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:15:38.393821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:38.393821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:38.393821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 621/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:15:38.399049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534570f-61d3-4f87-b68e-ca574672bc21 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:38.521652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534570f-61d3-4f87-b68e-ca574672bc21 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:38.566897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860b792-5a43-40a0-a135-bf1f537a16f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:38.567565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860b792-5a43-40a0-a135-bf1f537a16f0 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:38.567852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860b792-5a43-40a0-a135-bf1f537a16f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:38.568113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860b792-5a43-40a0-a135-bf1f537a16f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:38.568957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860b792-5a43-40a0-a135-bf1f537a16f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:38.569289 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860b792-5a43-40a0-a135-bf1f537a16f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:38.570787 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860b792-5a43-40a0-a135-bf1f537a16f0 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:38.584623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 610/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:38.598209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e74b9-c07a-4537-990b-d8958e9fd1ed None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:38.690760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:38.733567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e74b9-c07a-4537-990b-d8958e9fd1ed None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:38.771974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb1da1-877c-4570-ac28-b8ed8f2872d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:38.772582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb1da1-877c-4570-ac28-b8ed8f2872d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:38.772862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb1da1-877c-4570-ac28-b8ed8f2872d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:38.773191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb1da1-877c-4570-ac28-b8ed8f2872d2 None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/e42268a8b5944cbd9508a07c037112e3/roles/e564a081239e4e48a6b6257c8cec5e4d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:38.792082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb1da1-877c-4570-ac28-b8ed8f2872d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=e42268a8b5944cbd9508a07c037112e3, role_id=e564a081239e4e48a6b6257c8cec5e4d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:38.793973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb1da1-877c-4570-ac28-b8ed8f2872d2 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:38.817269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 622/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:15:38 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/e42268a8b5944cbd9508a07c037112e3/roles/e564a081239e4e48a6b6257c8cec5e4d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:15:41.011669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defc4cb-1871-44b1-bb5b-a17633ebfdd2 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:41.012204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defc4cb-1871-44b1-bb5b-a17633ebfdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:41.012204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defc4cb-1871-44b1-bb5b-a17633ebfdd2 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:41.013516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 611/1233] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:15:41.019348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e08de-a7f3-4a7e-8541-4796d9e53d65 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:41.020091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e08de-a7f3-4a7e-8541-4796d9e53d65 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:41.020091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e08de-a7f3-4a7e-8541-4796d9e53d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:41.038866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-804e08de-a7f3-4a7e-8541-4796d9e53d65 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:15:41.040081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-804e08de-a7f3-4a7e-8541-4796d9e53d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:15:41.111942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 623/1234] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:15:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:15:41.432651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defc4cb-1871-44b1-bb5b-a17633ebfdd2 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:41.464380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:41.554326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defc4cb-1871-44b1-bb5b-a17633ebfdd2 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:41.593513 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4654-7460-436d-97b8-7c0023870598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:41.594306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4654-7460-436d-97b8-7c0023870598 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:41.594674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4654-7460-436d-97b8-7c0023870598 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:41.595638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4654-7460-436d-97b8-7c0023870598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:41.609125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a4654-7460-436d-97b8-7c0023870598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ee0a4654-7460-436d-97b8-7c0023870598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:15:41.614032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:41.615185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:41.616200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 612/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Thu Sep 22 18:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:41.621358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e08de-a7f3-4a7e-8541-4796d9e53d65 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:41.669393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:41.725696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e08de-a7f3-4a7e-8541-4796d9e53d65 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:41.762988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc92d-1e9a-4d30-8f8c-8cec4e03bdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:41.763606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc92d-1e9a-4d30-8f8c-8cec4e03bdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:41.763881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc92d-1e9a-4d30-8f8c-8cec4e03bdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:41.764154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc92d-1e9a-4d30-8f8c-8cec4e03bdb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:41.764873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc92d-1e9a-4d30-8f8c-8cec4e03bdb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:41.765172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc92d-1e9a-4d30-8f8c-8cec4e03bdb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:41.767087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc92d-1e9a-4d30-8f8c-8cec4e03bdb7 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:41.775557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 624/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Thu Sep 22 18:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:41.782119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4654-7460-436d-97b8-7c0023870598 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:41.883734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:41.903335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4654-7460-436d-97b8-7c0023870598 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:41.943738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab861dbe-8620-4ebe-8c8f-9cf175572175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:41.944416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab861dbe-8620-4ebe-8c8f-9cf175572175 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:41.944709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab861dbe-8620-4ebe-8c8f-9cf175572175 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:41.945015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab861dbe-8620-4ebe-8c8f-9cf175572175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:41.955966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab861dbe-8620-4ebe-8c8f-9cf175572175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:41.957410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab861dbe-8620-4ebe-8c8f-9cf175572175 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-ab861dbe-8620-4ebe-8c8f-9cf175572175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:41.973073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:41.974224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:41.975133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:41.975133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:41.975133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:41.975133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 613/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:41.980670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc92d-1e9a-4d30-8f8c-8cec4e03bdb7 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:42.093360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc92d-1e9a-4d30-8f8c-8cec4e03bdb7 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:42.104204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:42.133518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74bf3-2cf9-46c9-968a-da1f76ec6c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:42.134257 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74bf3-2cf9-46c9-968a-da1f76ec6c3e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:42.134542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74bf3-2cf9-46c9-968a-da1f76ec6c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:42.134819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74bf3-2cf9-46c9-968a-da1f76ec6c3e None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:42.135535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd74bf3-2cf9-46c9-968a-da1f76ec6c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:42.135875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd74bf3-2cf9-46c9-968a-da1f76ec6c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:42.137474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd74bf3-2cf9-46c9-968a-da1f76ec6c3e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:42.155509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 625/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:42.156781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab861dbe-8620-4ebe-8c8f-9cf175572175 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:42.267608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab861dbe-8620-4ebe-8c8f-9cf175572175 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:42.312127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835094a1-0bd3-44d6-8f15-44dba65e3977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:42.312770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835094a1-0bd3-44d6-8f15-44dba65e3977 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:42.313051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835094a1-0bd3-44d6-8f15-44dba65e3977 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:42.313345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835094a1-0bd3-44d6-8f15-44dba65e3977 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:42.316172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:42.321978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835094a1-0bd3-44d6-8f15-44dba65e3977 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:42.323512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835094a1-0bd3-44d6-8f15-44dba65e3977 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-835094a1-0bd3-44d6-8f15-44dba65e3977 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:15:42.335246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:42.336278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:42.337691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 614/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:42.342290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74bf3-2cf9-46c9-968a-da1f76ec6c3e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:42.445114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74bf3-2cf9-46c9-968a-da1f76ec6c3e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:42.484149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8165460-aa88-4d43-8207-b405669a4361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:42.484828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165460-aa88-4d43-8207-b405669a4361 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:42.485150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165460-aa88-4d43-8207-b405669a4361 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:42.485522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165460-aa88-4d43-8207-b405669a4361 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:42.486257 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8165460-aa88-4d43-8207-b405669a4361 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:42.486576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8165460-aa88-4d43-8207-b405669a4361 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:42.488009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8165460-aa88-4d43-8207-b405669a4361 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:42.508660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 626/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Thu Sep 22 18:15:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:42.515065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835094a1-0bd3-44d6-8f15-44dba65e3977 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:42.632767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835094a1-0bd3-44d6-8f15-44dba65e3977 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:42.674266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c23b-77ec-4d5e-b344-06b2bb80a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:42.676338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c23b-77ec-4d5e-b344-06b2bb80a868 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:42.676338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c23b-77ec-4d5e-b344-06b2bb80a868 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:42.676740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c23b-77ec-4d5e-b344-06b2bb80a868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:42.746619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:42.756450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820c23b-77ec-4d5e-b344-06b2bb80a868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:42.758238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820c23b-77ec-4d5e-b344-06b2bb80a868 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:42.868036 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 615/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:15:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:15:42.877777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8165460-aa88-4d43-8207-b405669a4361 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:42.909275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:42.989355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8165460-aa88-4d43-8207-b405669a4361 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:43.025160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c65d9-80cc-4eaf-bc73-f72c237961bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:43.025836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c65d9-80cc-4eaf-bc73-f72c237961bd None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:43.026114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c65d9-80cc-4eaf-bc73-f72c237961bd None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:43.026406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c65d9-80cc-4eaf-bc73-f72c237961bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:43.036544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c65d9-80cc-4eaf-bc73-f72c237961bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:43.038007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c65d9-80cc-4eaf-bc73-f72c237961bd None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-912c65d9-80cc-4eaf-bc73-f72c237961bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:43.055619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:43.056638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:43.057604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:43.057604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:43.057604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:43.057604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 627/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:43.064308 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c23b-77ec-4d5e-b344-06b2bb80a868 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:43.166069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:43.172547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c23b-77ec-4d5e-b344-06b2bb80a868 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:43.218958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef10582-4d1b-4714-9cdf-337507bd159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:43.219690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10582-4d1b-4714-9cdf-337507bd159d None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:43.220586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10582-4d1b-4714-9cdf-337507bd159d None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:43.220862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10582-4d1b-4714-9cdf-337507bd159d None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:43.221593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10582-4d1b-4714-9cdf-337507bd159d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:43.221894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10582-4d1b-4714-9cdf-337507bd159d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:43.223325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10582-4d1b-4714-9cdf-337507bd159d None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:43.235225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 616/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:43.241197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c65d9-80cc-4eaf-bc73-f72c237961bd None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:43.339867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:43.366029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c65d9-80cc-4eaf-bc73-f72c237961bd None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:43.404117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01fb4-e439-420c-ba3e-dfdb0b7b1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:43.404763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01fb4-e439-420c-ba3e-dfdb0b7b1dce None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:43.405047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01fb4-e439-420c-ba3e-dfdb0b7b1dce None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:43.405352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc01fb4-e439-420c-ba3e-dfdb0b7b1dce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:43.412647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc01fb4-e439-420c-ba3e-dfdb0b7b1dce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:43.414134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc01fb4-e439-420c-ba3e-dfdb0b7b1dce None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-4fc01fb4-e439-420c-ba3e-dfdb0b7b1dce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:15:43.425860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:43.426992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:43.428056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:15:43.428056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:15:43.428056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:15:43.428056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:15:43.428056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:15:43.428056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:15:43.428056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:43.428056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:43.428056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 628/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:43.433426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef10582-4d1b-4714-9cdf-337507bd159d None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:43.550186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef10582-4d1b-4714-9cdf-337507bd159d None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:43.588969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aad94c-1750-4e1b-bca6-a5be2ca9299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:43.589738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aad94c-1750-4e1b-bca6-a5be2ca9299b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:43.590071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aad94c-1750-4e1b-bca6-a5be2ca9299b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:43.590427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aad94c-1750-4e1b-bca6-a5be2ca9299b None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:43.591138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aad94c-1750-4e1b-bca6-a5be2ca9299b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:43.591450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aad94c-1750-4e1b-bca6-a5be2ca9299b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:43.593082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aad94c-1750-4e1b-bca6-a5be2ca9299b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:43.612970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 617/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:15:43.614183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01fb4-e439-420c-ba3e-dfdb0b7b1dce None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:43.727862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc01fb4-e439-420c-ba3e-dfdb0b7b1dce None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:43.770288 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc7677-c257-4b6b-ab72-0b3053e154be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:43.770982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc7677-c257-4b6b-ab72-0b3053e154be None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:43.771297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc7677-c257-4b6b-ab72-0b3053e154be None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:43.771593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc7677-c257-4b6b-ab72-0b3053e154be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:43.772380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc7677-c257-4b6b-ab72-0b3053e154be None admin] RBAC: Adding query filter params (role.id=e564a081239e4e48a6b6257c8cec5e4d, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=e42268a8b5944cbd9508a07c037112e3) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:43.772748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc7677-c257-4b6b-ab72-0b3053e154be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:43.774543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc7677-c257-4b6b-ab72-0b3053e154be None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:43.788788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 629/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:15:43 2022] GET /identity/v3/role_assignments?user.id=e42268a8b5944cbd9508a07c037112e3&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=e564a081239e4e48a6b6257c8cec5e4d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:46.077332 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821bb18-0f12-41be-b7da-720f3132daf7 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:46.077850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821bb18-0f12-41be-b7da-720f3132daf7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:46.077850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821bb18-0f12-41be-b7da-720f3132daf7 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:46.079222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 618/1247] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:15:46.084647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af182b95-0163-4541-8a4a-f2bf4e9ac686 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:46.085075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af182b95-0163-4541-8a4a-f2bf4e9ac686 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:46.085201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af182b95-0163-4541-8a4a-f2bf4e9ac686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:46.091669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:46.105927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-af182b95-0163-4541-8a4a-f2bf4e9ac686 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:15:46.107258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-af182b95-0163-4541-8a4a-f2bf4e9ac686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:15:46.186989 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 630/1248] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:15:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:15:46.460909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821bb18-0f12-41be-b7da-720f3132daf7 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:46.482392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:46.575875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821bb18-0f12-41be-b7da-720f3132daf7 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:46.621502 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d8a1f-3c8e-41ea-9b73-adfe599ddcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:46.622161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8a1f-3c8e-41ea-9b73-adfe599ddcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:46.622442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8a1f-3c8e-41ea-9b73-adfe599ddcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:46.622719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8a1f-3c8e-41ea-9b73-adfe599ddcb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:46.634874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d8a1f-3c8e-41ea-9b73-adfe599ddcb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-666d8a1f-3c8e-41ea-9b73-adfe599ddcb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:15:46.639783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:46.641127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:46.642270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 619/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:46.647229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af182b95-0163-4541-8a4a-f2bf4e9ac686 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:46.756029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af182b95-0163-4541-8a4a-f2bf4e9ac686 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:46.788071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:46.793214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e34c-4f51-4def-adc9-25ca6f09eb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:46.793844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e34c-4f51-4def-adc9-25ca6f09eb75 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:46.794122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e34c-4f51-4def-adc9-25ca6f09eb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:46.794392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e34c-4f51-4def-adc9-25ca6f09eb75 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:46.795043 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2e34c-4f51-4def-adc9-25ca6f09eb75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:46.795344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2e34c-4f51-4def-adc9-25ca6f09eb75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:46.796702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2e34c-4f51-4def-adc9-25ca6f09eb75 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:46.804704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 631/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:46.810831 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d8a1f-3c8e-41ea-9b73-adfe599ddcb0 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:46.893748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:46.919280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d8a1f-3c8e-41ea-9b73-adfe599ddcb0 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:46.964636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bace0f4-3da9-4615-9878-0a0195a90ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:46.965603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bace0f4-3da9-4615-9878-0a0195a90ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:46.966120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bace0f4-3da9-4615-9878-0a0195a90ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:46.966667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bace0f4-3da9-4615-9878-0a0195a90ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:46.978737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bace0f4-3da9-4615-9878-0a0195a90ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:46.980294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bace0f4-3da9-4615-9878-0a0195a90ff2 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-9bace0f4-3da9-4615-9878-0a0195a90ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:46.995422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:46.996583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:46.998048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:46.998048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:46.998048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:46.998048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 620/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:47.002954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e34c-4f51-4def-adc9-25ca6f09eb75 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:47.116817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e34c-4f51-4def-adc9-25ca6f09eb75 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:47.155421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d4166-0b98-4e4c-a45a-3253d9fddae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:47.156123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d4166-0b98-4e4c-a45a-3253d9fddae6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:47.156409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d4166-0b98-4e4c-a45a-3253d9fddae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:47.156753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d4166-0b98-4e4c-a45a-3253d9fddae6 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:47.158057 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d4166-0b98-4e4c-a45a-3253d9fddae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:47.158416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d4166-0b98-4e4c-a45a-3253d9fddae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:47.160180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d4166-0b98-4e4c-a45a-3253d9fddae6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:47.174603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 632/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:47.180347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bace0f4-3da9-4615-9878-0a0195a90ff2 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:47.294574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bace0f4-3da9-4615-9878-0a0195a90ff2 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:47.325273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:47.334817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde8e79-f314-4281-957e-ccc4d8e43661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:47.335442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde8e79-f314-4281-957e-ccc4d8e43661 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:47.335725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde8e79-f314-4281-957e-ccc4d8e43661 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:47.336001 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde8e79-f314-4281-957e-ccc4d8e43661 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:47.344026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde8e79-f314-4281-957e-ccc4d8e43661 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:47.346395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde8e79-f314-4281-957e-ccc4d8e43661 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-4bde8e79-f314-4281-957e-ccc4d8e43661 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:15:47.358808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:47.360068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:47.361964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:47.365421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 621/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:47.366512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d4166-0b98-4e4c-a45a-3253d9fddae6 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:47.425161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:47.478804 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d4166-0b98-4e4c-a45a-3253d9fddae6 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:47.518411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f9afc-6a98-4eee-b66a-89657f302a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:47.519070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f9afc-6a98-4eee-b66a-89657f302a0a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:47.519354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f9afc-6a98-4eee-b66a-89657f302a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:47.519628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f9afc-6a98-4eee-b66a-89657f302a0a None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:47.520417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f9afc-6a98-4eee-b66a-89657f302a0a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:47.520728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f9afc-6a98-4eee-b66a-89657f302a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:47.522256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f9afc-6a98-4eee-b66a-89657f302a0a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:47.541454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 633/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Thu Sep 22 18:15:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:47.547631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde8e79-f314-4281-957e-ccc4d8e43661 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:47.668423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde8e79-f314-4281-957e-ccc4d8e43661 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:47.712086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a629f-cab5-4aed-814e-6aaf12eea1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:47.712697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a629f-cab5-4aed-814e-6aaf12eea1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:47.712972 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a629f-cab5-4aed-814e-6aaf12eea1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:47.713264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a629f-cab5-4aed-814e-6aaf12eea1a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:47.786658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:47.795291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a629f-cab5-4aed-814e-6aaf12eea1a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:47.796780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a629f-cab5-4aed-814e-6aaf12eea1a7 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:47.905115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 622/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:15:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 18:15:47.912020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f9afc-6a98-4eee-b66a-89657f302a0a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:48.020904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f9afc-6a98-4eee-b66a-89657f302a0a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:48.035354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:48.060809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da65f6c-62fc-4b93-9988-1d5151741698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:48.061506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da65f6c-62fc-4b93-9988-1d5151741698 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:48.061783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da65f6c-62fc-4b93-9988-1d5151741698 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:48.062056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da65f6c-62fc-4b93-9988-1d5151741698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:48.073654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da65f6c-62fc-4b93-9988-1d5151741698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:48.075118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da65f6c-62fc-4b93-9988-1d5151741698 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-6da65f6c-62fc-4b93-9988-1d5151741698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:48.091251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:48.092493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:48.093843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:48.093843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:48.093843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:48.093843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 634/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:48.098745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a629f-cab5-4aed-814e-6aaf12eea1a7 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:48.195654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:48.209100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a629f-cab5-4aed-814e-6aaf12eea1a7 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:48.244552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4f368-7be9-4de7-856d-1ce4ecff3a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:48.245183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4f368-7be9-4de7-856d-1ce4ecff3a08 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:48.245495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4f368-7be9-4de7-856d-1ce4ecff3a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:48.245824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4f368-7be9-4de7-856d-1ce4ecff3a08 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:48.246425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4f368-7be9-4de7-856d-1ce4ecff3a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:48.246732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4f368-7be9-4de7-856d-1ce4ecff3a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:48.248089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4f368-7be9-4de7-856d-1ce4ecff3a08 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:48.260619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 623/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:48.266789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da65f6c-62fc-4b93-9988-1d5151741698 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:48.382236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da65f6c-62fc-4b93-9988-1d5151741698 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:48.415842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06363b1-ab14-41ba-b17d-75ae2549f02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:48.416496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06363b1-ab14-41ba-b17d-75ae2549f02a None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:48.416785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06363b1-ab14-41ba-b17d-75ae2549f02a None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:48.417063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06363b1-ab14-41ba-b17d-75ae2549f02a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:48.425361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06363b1-ab14-41ba-b17d-75ae2549f02a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:48.426818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06363b1-ab14-41ba-b17d-75ae2549f02a None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-f06363b1-ab14-41ba-b17d-75ae2549f02a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:15:48.439807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:48.440891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:48.442021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:15:48.442021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:15:48.442021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:15:48.442021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:15:48.442021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:15:48.442021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:15:48.442021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:48.442021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:48.442021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 635/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:48.448843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4f368-7be9-4de7-856d-1ce4ecff3a08 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:48.550638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4f368-7be9-4de7-856d-1ce4ecff3a08 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:48.584738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb04c0c-6955-4be4-83b7-de34138b596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:48.585469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04c0c-6955-4be4-83b7-de34138b596e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:48.585806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04c0c-6955-4be4-83b7-de34138b596e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:48.586079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04c0c-6955-4be4-83b7-de34138b596e None admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:48.586772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb04c0c-6955-4be4-83b7-de34138b596e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:48.587079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb04c0c-6955-4be4-83b7-de34138b596e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:48.588498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb04c0c-6955-4be4-83b7-de34138b596e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:48.600542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 624/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:15:48.606716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06363b1-ab14-41ba-b17d-75ae2549f02a None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:48.632660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:48.706737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06363b1-ab14-41ba-b17d-75ae2549f02a None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:48.738938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be12c-9295-4cd2-92b7-0e448ddadee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:48.739546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be12c-9295-4cd2-92b7-0e448ddadee6 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:48.739826 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be12c-9295-4cd2-92b7-0e448ddadee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:48.740097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be12c-9295-4cd2-92b7-0e448ddadee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:48.740818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be12c-9295-4cd2-92b7-0e448ddadee6 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=e42268a8b5944cbd9508a07c037112e3) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:48.741125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be12c-9295-4cd2-92b7-0e448ddadee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:48.742581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be12c-9295-4cd2-92b7-0e448ddadee6 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:48.748639 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 636/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:15:48 2022] GET /identity/v3/role_assignments?user.id=e42268a8b5944cbd9508a07c037112e3&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:50.858428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c88a1-a316-44ef-ac69-458f01ee5b9e None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:50.858943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c88a1-a316-44ef-ac69-458f01ee5b9e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:50.859031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c88a1-a316-44ef-ac69-458f01ee5b9e None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:50.860321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 625/1261] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:15:50.866019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b3406-e7fc-4b48-b018-34de39289dce None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:50.866487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b3406-e7fc-4b48-b018-34de39289dce None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:50.866645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b3406-e7fc-4b48-b018-34de39289dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:50.885404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4c8b3406-e7fc-4b48-b018-34de39289dce None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:15:50.886607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4c8b3406-e7fc-4b48-b018-34de39289dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:15:50.951467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 637/1262] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:15:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:15:51.221644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c88a1-a316-44ef-ac69-458f01ee5b9e None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:51.232380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:51.329980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c88a1-a316-44ef-ac69-458f01ee5b9e None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:51.365656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ddf7-adc7-4102-ad66-ad6b3f052ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:51.366285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ddf7-adc7-4102-ad66-ad6b3f052ccb None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:51.366575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ddf7-adc7-4102-ad66-ad6b3f052ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:51.366849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ddf7-adc7-4102-ad66-ad6b3f052ccb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:51.377378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4ddf7-adc7-4102-ad66-ad6b3f052ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-2ed4ddf7-adc7-4102-ad66-ad6b3f052ccb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:15:51.382156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:51.383239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:51.384080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 626/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:51.389384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b3406-e7fc-4b48-b018-34de39289dce None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:51.407044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:51.486350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b3406-e7fc-4b48-b018-34de39289dce None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:51.519120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dba82-d028-4c1e-97ed-4822330e4cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:51.519716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dba82-d028-4c1e-97ed-4822330e4cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:51.519994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dba82-d028-4c1e-97ed-4822330e4cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:51.520265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dba82-d028-4c1e-97ed-4822330e4cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:51.520920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dba82-d028-4c1e-97ed-4822330e4cc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:51.521223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dba82-d028-4c1e-97ed-4822330e4cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:51.522606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dba82-d028-4c1e-97ed-4822330e4cc3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:51.530371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 638/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:51.536112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ddf7-adc7-4102-ad66-ad6b3f052ccb None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:51.603670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:51.638868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ddf7-adc7-4102-ad66-ad6b3f052ccb None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:51.672248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bebc4e-63e7-43e2-9de0-288ae0211736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:51.672884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bebc4e-63e7-43e2-9de0-288ae0211736 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:51.673765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bebc4e-63e7-43e2-9de0-288ae0211736 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:51.674042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bebc4e-63e7-43e2-9de0-288ae0211736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:51.684390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bebc4e-63e7-43e2-9de0-288ae0211736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:51.685881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bebc4e-63e7-43e2-9de0-288ae0211736 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-01bebc4e-63e7-43e2-9de0-288ae0211736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:51.699664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:51.700727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:51.702035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:51.702035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:51.702035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:51.702035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 627/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:51.706541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dba82-d028-4c1e-97ed-4822330e4cc3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:51.784952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:51.803860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dba82-d028-4c1e-97ed-4822330e4cc3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:51.835443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a85ae-c069-432b-8149-3cd10b80f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:51.836041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a85ae-c069-432b-8149-3cd10b80f272 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:51.836327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a85ae-c069-432b-8149-3cd10b80f272 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:51.836599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a85ae-c069-432b-8149-3cd10b80f272 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:51.837221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a85ae-c069-432b-8149-3cd10b80f272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:51.837550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a85ae-c069-432b-8149-3cd10b80f272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:51.838899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a85ae-c069-432b-8149-3cd10b80f272 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:51.854971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 639/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:51.861497 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bebc4e-63e7-43e2-9de0-288ae0211736 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:51.959289 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bebc4e-63e7-43e2-9de0-288ae0211736 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:51.979638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:51.994086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafffa65-1c8d-4e28-ad53-b095a778b820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:51.994714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafffa65-1c8d-4e28-ad53-b095a778b820 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:51.994994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafffa65-1c8d-4e28-ad53-b095a778b820 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:51.995266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafffa65-1c8d-4e28-ad53-b095a778b820 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:52.003536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafffa65-1c8d-4e28-ad53-b095a778b820 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:52.006259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafffa65-1c8d-4e28-ad53-b095a778b820 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-cafffa65-1c8d-4e28-ad53-b095a778b820 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:15:52.018138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:52.019262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:52.020505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 628/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:52.025288 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a85ae-c069-432b-8149-3cd10b80f272 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:52.124722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a85ae-c069-432b-8149-3cd10b80f272 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:52.159028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064436b-fa52-4e08-b261-4f75ed4dc412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:52.159687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064436b-fa52-4e08-b261-4f75ed4dc412 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:52.159966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064436b-fa52-4e08-b261-4f75ed4dc412 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:52.160239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064436b-fa52-4e08-b261-4f75ed4dc412 None admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:52.161089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064436b-fa52-4e08-b261-4f75ed4dc412 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:52.161427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064436b-fa52-4e08-b261-4f75ed4dc412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:52.162853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064436b-fa52-4e08-b261-4f75ed4dc412 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:52.171455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:52.180861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 640/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Thu Sep 22 18:15:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:52.186694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafffa65-1c8d-4e28-ad53-b095a778b820 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:52.291255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafffa65-1c8d-4e28-ad53-b095a778b820 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:52.327563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e88b8-7fff-4091-b2ee-65b4da01e033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:52.328218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e88b8-7fff-4091-b2ee-65b4da01e033 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:52.328499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e88b8-7fff-4091-b2ee-65b4da01e033 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:52.328772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e88b8-7fff-4091-b2ee-65b4da01e033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:52.339404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e88b8-7fff-4091-b2ee-65b4da01e033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:52.340835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e88b8-7fff-4091-b2ee-65b4da01e033 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-398e88b8-7fff-4091-b2ee-65b4da01e033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:52.355579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:52.356777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:52.357749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:52.357749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:52.357749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:52.357749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 629/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:52.362902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064436b-fa52-4e08-b261-4f75ed4dc412 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:52.466904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064436b-fa52-4e08-b261-4f75ed4dc412 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:52.499609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb56b3-9bbd-47cd-a0ee-875c133b3f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:52.500211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb56b3-9bbd-47cd-a0ee-875c133b3f8f None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:52.500489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb56b3-9bbd-47cd-a0ee-875c133b3f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:52.500759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb56b3-9bbd-47cd-a0ee-875c133b3f8f None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:52.501909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb56b3-9bbd-47cd-a0ee-875c133b3f8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:52.502213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb56b3-9bbd-47cd-a0ee-875c133b3f8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:52.503571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb56b3-9bbd-47cd-a0ee-875c133b3f8f None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:52.514560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 641/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:15:52.520835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e88b8-7fff-4091-b2ee-65b4da01e033 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:52.551540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:52.622854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e88b8-7fff-4091-b2ee-65b4da01e033 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:52.661501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e76e4-49a5-4ee4-b23f-ee640572e168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:52.664048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e76e4-49a5-4ee4-b23f-ee640572e168 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:52.664331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e76e4-49a5-4ee4-b23f-ee640572e168 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:52.664609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e76e4-49a5-4ee4-b23f-ee640572e168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:52.674999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e76e4-49a5-4ee4-b23f-ee640572e168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:52.676455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e76e4-49a5-4ee4-b23f-ee640572e168 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-3b8e76e4-49a5-4ee4-b23f-ee640572e168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:15:52.687927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:52.689827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:52.690897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:15:52.690897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:15:52.690897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:15:52.690897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:15:52.690897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:15:52.690897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:15:52.690897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:52.690897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:52.690897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 630/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:15:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 18:15:52.695888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb56b3-9bbd-47cd-a0ee-875c133b3f8f None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:52.755394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:52.796658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb56b3-9bbd-47cd-a0ee-875c133b3f8f None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:52.830778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b1028-b7da-4ef1-95de-71f922798f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:52.831380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b1028-b7da-4ef1-95de-71f922798f08 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:52.831663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b1028-b7da-4ef1-95de-71f922798f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:52.831938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b1028-b7da-4ef1-95de-71f922798f08 None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:52.832621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b1028-b7da-4ef1-95de-71f922798f08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:52.832931 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b1028-b7da-4ef1-95de-71f922798f08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:52.834384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b1028-b7da-4ef1-95de-71f922798f08 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:52.846857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 642/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:15:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:52.852868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e76e4-49a5-4ee4-b23f-ee640572e168 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:52.949856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:52.959610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e76e4-49a5-4ee4-b23f-ee640572e168 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:52.993374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c289685-df2f-4064-b58f-c2ff4df440b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:52.994030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289685-df2f-4064-b58f-c2ff4df440b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:52.994313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289685-df2f-4064-b58f-c2ff4df440b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:52.994589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289685-df2f-4064-b58f-c2ff4df440b4 None admin] PATH_INFO: `/v3/projects/834afef9c82248f996e13710c40e7ee3/users/e42268a8b5944cbd9508a07c037112e3/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:52.996453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c289685-df2f-4064-b58f-c2ff4df440b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=834afef9c82248f996e13710c40e7ee3, user_id=e42268a8b5944cbd9508a07c037112e3, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:52.997919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c289685-df2f-4064-b58f-c2ff4df440b4 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:53.010246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 631/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Thu Sep 22 18:15:52 2022] PUT /identity/v3/projects/834afef9c82248f996e13710c40e7ee3/users/e42268a8b5944cbd9508a07c037112e3/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:15:55.132394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c1927-0b71-4968-8a9b-fd067271a5ab None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:55.132916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c1927-0b71-4968-8a9b-fd067271a5ab None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:55.132916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c1927-0b71-4968-8a9b-fd067271a5ab None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:55.134208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 643/1274] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:15:55.139344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87584-e278-4e98-b801-4f576810f830 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:55.139769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87584-e278-4e98-b801-4f576810f830 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:55.139945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87584-e278-4e98-b801-4f576810f830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:55.159065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-55c87584-e278-4e98-b801-4f576810f830 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:15:55.160260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-55c87584-e278-4e98-b801-4f576810f830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:15:55.230015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 632/1275] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:15:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:15:55.522043 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c1927-0b71-4968-8a9b-fd067271a5ab None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:55.622073 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c1927-0b71-4968-8a9b-fd067271a5ab None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:55.639027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:55.655860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780648f9-396c-429a-9403-fc46d8e234ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:55.656506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780648f9-396c-429a-9403-fc46d8e234ff None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:55.656794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780648f9-396c-429a-9403-fc46d8e234ff None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:55.657072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780648f9-396c-429a-9403-fc46d8e234ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:55.667956 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780648f9-396c-429a-9403-fc46d8e234ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-780648f9-396c-429a-9403-fc46d8e234ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 18:15:55.672807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:55.674334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:55.675821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 644/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Thu Sep 22 18:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:55.680461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c87584-e278-4e98-b801-4f576810f830 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:55.766572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:55.786708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c87584-e278-4e98-b801-4f576810f830 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:55.819026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e4bdf-b904-4d94-8fc5-c8f1fd47b0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:55.819628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e4bdf-b904-4d94-8fc5-c8f1fd47b0fe None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:55.819909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e4bdf-b904-4d94-8fc5-c8f1fd47b0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:55.820183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e4bdf-b904-4d94-8fc5-c8f1fd47b0fe None admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:55.820842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e4bdf-b904-4d94-8fc5-c8f1fd47b0fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:55.821145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e4bdf-b904-4d94-8fc5-c8f1fd47b0fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:55.822525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e4bdf-b904-4d94-8fc5-c8f1fd47b0fe None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:55.830809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 633/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Thu Sep 22 18:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:55.836631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780648f9-396c-429a-9403-fc46d8e234ff None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:55.941633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780648f9-396c-429a-9403-fc46d8e234ff None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:55.975558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f5cb-9c79-4465-85f2-40d43f6085bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:55.976198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f5cb-9c79-4465-85f2-40d43f6085bb None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:55.976473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f5cb-9c79-4465-85f2-40d43f6085bb None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:55.976750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f5cb-9c79-4465-85f2-40d43f6085bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:55.988394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037f5cb-9c79-4465-85f2-40d43f6085bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:55.991406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037f5cb-9c79-4465-85f2-40d43f6085bb None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-1037f5cb-9c79-4465-85f2-40d43f6085bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:56.005951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:56.006897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:56.007778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:56.007778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:56.007778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:56.007778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 645/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:56.013396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e4bdf-b904-4d94-8fc5-c8f1fd47b0fe None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:56.121912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e4bdf-b904-4d94-8fc5-c8f1fd47b0fe None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:56.154621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f364c-c0de-4249-ab65-7350bddf0007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:56.155224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f364c-c0de-4249-ab65-7350bddf0007 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:56.155508 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f364c-c0de-4249-ab65-7350bddf0007 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:56.155786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f364c-c0de-4249-ab65-7350bddf0007 None admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:56.156434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f364c-c0de-4249-ab65-7350bddf0007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:56.156742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f364c-c0de-4249-ab65-7350bddf0007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:56.158657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f364c-c0de-4249-ab65-7350bddf0007 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:56.170183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 634/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:56.176486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f5cb-9c79-4465-85f2-40d43f6085bb None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:56.213349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:56.285341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f5cb-9c79-4465-85f2-40d43f6085bb None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:56.320247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5589129-79fc-4e8a-95e2-4a6d4ca5463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:56.320882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5589129-79fc-4e8a-95e2-4a6d4ca5463c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:56.321165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5589129-79fc-4e8a-95e2-4a6d4ca5463c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:56.321469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5589129-79fc-4e8a-95e2-4a6d4ca5463c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:56.330565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5589129-79fc-4e8a-95e2-4a6d4ca5463c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:56.331997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5589129-79fc-4e8a-95e2-4a6d4ca5463c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-e5589129-79fc-4e8a-95e2-4a6d4ca5463c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 18:15:56.343001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:56.344063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:15:56.345609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 646/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:56.350940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f364c-c0de-4249-ab65-7350bddf0007 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:56.354774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:56.455986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f364c-c0de-4249-ab65-7350bddf0007 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:56.490027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b701477-c7b6-40aa-bf60-e58a7c6f1529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:56.490618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b701477-c7b6-40aa-bf60-e58a7c6f1529 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:56.490898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b701477-c7b6-40aa-bf60-e58a7c6f1529 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:56.491164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b701477-c7b6-40aa-bf60-e58a7c6f1529 None admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:56.491884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b701477-c7b6-40aa-bf60-e58a7c6f1529 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:56.492183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b701477-c7b6-40aa-bf60-e58a7c6f1529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:56.493616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b701477-c7b6-40aa-bf60-e58a7c6f1529 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:56.510242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 635/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Thu Sep 22 18:15:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:56.516071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5589129-79fc-4e8a-95e2-4a6d4ca5463c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:56.606359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:56.616729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5589129-79fc-4e8a-95e2-4a6d4ca5463c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:56.649811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2c3a8-a346-4036-ae28-2d82fb1c437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:56.650413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2c3a8-a346-4036-ae28-2d82fb1c437e None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:56.650696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2c3a8-a346-4036-ae28-2d82fb1c437e None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:56.650969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2c3a8-a346-4036-ae28-2d82fb1c437e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:56.724836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2c3a8-a346-4036-ae28-2d82fb1c437e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:56.726240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2c3a8-a346-4036-ae28-2d82fb1c437e None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:56.813227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:56.823654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 647/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Thu Sep 22 18:15:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 18:15:56.829966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b701477-c7b6-40aa-bf60-e58a7c6f1529 None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:56.889804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:56.927890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b701477-c7b6-40aa-bf60-e58a7c6f1529 None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:56.961372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332186c-b9ca-44a5-95e6-a7c1d5159a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:56.962007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332186c-b9ca-44a5-95e6-a7c1d5159a3e None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:56.962288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332186c-b9ca-44a5-95e6-a7c1d5159a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:56.962558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332186c-b9ca-44a5-95e6-a7c1d5159a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:56.973296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332186c-b9ca-44a5-95e6-a7c1d5159a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:56.974749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332186c-b9ca-44a5-95e6-a7c1d5159a3e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-1332186c-b9ca-44a5-95e6-a7c1d5159a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 18:15:56.989264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:56.990540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 18:15:56.991561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 18:15:56.991561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 18:15:56.991561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:56.991561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 636/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:56.996550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2c3a8-a346-4036-ae28-2d82fb1c437e None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:57.097193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2c3a8-a346-4036-ae28-2d82fb1c437e None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:57.129830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ebe10-5934-47e8-910b-3c996dd260e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:57.130430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ebe10-5934-47e8-910b-3c996dd260e3 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:57.130707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ebe10-5934-47e8-910b-3c996dd260e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:57.130982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ebe10-5934-47e8-910b-3c996dd260e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:57.131613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ebe10-5934-47e8-910b-3c996dd260e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:57.131918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ebe10-5934-47e8-910b-3c996dd260e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:57.133294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ebe10-5934-47e8-910b-3c996dd260e3 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:57.144612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 648/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Thu Sep 22 18:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:57.150467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332186c-b9ca-44a5-95e6-a7c1d5159a3e None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:57.250657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332186c-b9ca-44a5-95e6-a7c1d5159a3e None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:57.264736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:57.288451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e60c18-3bf1-4745-99c1-6bd2f62bc4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:57.289089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60c18-3bf1-4745-99c1-6bd2f62bc4ea None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:57.289405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60c18-3bf1-4745-99c1-6bd2f62bc4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:57.289679 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60c18-3bf1-4745-99c1-6bd2f62bc4ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:57.296275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e60c18-3bf1-4745-99c1-6bd2f62bc4ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:57.297752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e60c18-3bf1-4745-99c1-6bd2f62bc4ea None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application [None req-b3e60c18-3bf1-4745-99c1-6bd2f62bc4ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 18:15:57.309248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application with Lock( Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:15:57.310396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:15:57.311322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 18:15:57.311322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 18:15:57.311322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 18:15:57.311322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 18:15:57.311322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 18:15:57.311322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 18:15:57.311322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 18:15:57.311322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: ERROR keystone.server.flask.application Sep 22 18:15:57.311322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 637/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Thu Sep 22 18:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:15:57.316805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ebe10-5934-47e8-910b-3c996dd260e3 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:57.365527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:57.414994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ebe10-5934-47e8-910b-3c996dd260e3 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:57.448119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898b8c5-ffd0-4857-9e55-8ef937a8d7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:57.448721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898b8c5-ffd0-4857-9e55-8ef937a8d7be None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:57.449002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898b8c5-ffd0-4857-9e55-8ef937a8d7be None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:57.449297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898b8c5-ffd0-4857-9e55-8ef937a8d7be None admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:57.449979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898b8c5-ffd0-4857-9e55-8ef937a8d7be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:57.450284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898b8c5-ffd0-4857-9e55-8ef937a8d7be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:57.451700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898b8c5-ffd0-4857-9e55-8ef937a8d7be None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:57.463801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 649/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Thu Sep 22 18:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:15:57.470103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e60c18-3bf1-4745-99c1-6bd2f62bc4ea None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:15:57.569897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e60c18-3bf1-4745-99c1-6bd2f62bc4ea None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:15:57.602874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ec0a-7d37-406b-ba7d-1456bf6f25a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:15:57.603477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ec0a-7d37-406b-ba7d-1456bf6f25a5 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:57.603758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ec0a-7d37-406b-ba7d-1456bf6f25a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:57.604031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ec0a-7d37-406b-ba7d-1456bf6f25a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:57.604748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ec0a-7d37-406b-ba7d-1456bf6f25a5 None admin] RBAC: Adding query filter params (role.id=896af79d4273418bbc5535435dd0d6b6, scope.project.id=834afef9c82248f996e13710c40e7ee3, user.id=e42268a8b5944cbd9508a07c037112e3) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:15:57.605055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ec0a-7d37-406b-ba7d-1456bf6f25a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:15:57.606499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ec0a-7d37-406b-ba7d-1456bf6f25a5 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:15:57.612629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 638/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Thu Sep 22 18:15:57 2022] GET /identity/v3/role_assignments?user.id=e42268a8b5944cbd9508a07c037112e3&scope.project.id=834afef9c82248f996e13710c40e7ee3&role.id=896af79d4273418bbc5535435dd0d6b6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:15:59.789326 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf76cb-5b7b-4ed5-8e3c-58786bbaa52a None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:59.789861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf76cb-5b7b-4ed5-8e3c-58786bbaa52a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:59.789861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf76cb-5b7b-4ed5-8e3c-58786bbaa52a None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:59.791198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 650/1288] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:15:59.796538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e78a90-79ff-4024-a920-58d40f197eb2 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:15:59.796950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e78a90-79ff-4024-a920-58d40f197eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:15:59.797095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e78a90-79ff-4024-a920-58d40f197eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:15:59.815016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-45e78a90-79ff-4024-a920-58d40f197eb2 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:15:59.816192 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-45e78a90-79ff-4024-a920-58d40f197eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:15:59.846347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:15:59.883026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 639/1289] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:15:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:16:00.162295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf76cb-5b7b-4ed5-8e3c-58786bbaa52a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:00.263297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf76cb-5b7b-4ed5-8e3c-58786bbaa52a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:00.276924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:16:00.306439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126745f9-8a56-46d7-88ca-f19aaa344597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:00.307142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126745f9-8a56-46d7-88ca-f19aaa344597 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:00.307463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126745f9-8a56-46d7-88ca-f19aaa344597 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:00.307806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126745f9-8a56-46d7-88ca-f19aaa344597 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:00.308466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126745f9-8a56-46d7-88ca-f19aaa344597 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:00.310116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126745f9-8a56-46d7-88ca-f19aaa344597 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-126745f9-8a56-46d7-88ca-f19aaa344597 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:16:00.321072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:16:00.322323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:16:00.323346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 651/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:16:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:16:00.328845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e78a90-79ff-4024-a920-58d40f197eb2 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:00.432894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e78a90-79ff-4024-a920-58d40f197eb2 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:00.465524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822674-f230-4ebc-bd36-0226acccc2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:00.466131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822674-f230-4ebc-bd36-0226acccc2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:00.466411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822674-f230-4ebc-bd36-0226acccc2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:00.466682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822674-f230-4ebc-bd36-0226acccc2c6 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:00.467306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9822674-f230-4ebc-bd36-0226acccc2c6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:16:00.467603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9822674-f230-4ebc-bd36-0226acccc2c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:00.468956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9822674-f230-4ebc-bd36-0226acccc2c6 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:00.474569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 640/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Thu Sep 22 18:16:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:16:00.480364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126745f9-8a56-46d7-88ca-f19aaa344597 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:00.577245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126745f9-8a56-46d7-88ca-f19aaa344597 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:00.611509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4f3cb-ac03-4b5d-af2d-e702d4b59311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:00.612108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f3cb-ac03-4b5d-af2d-e702d4b59311 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:00.612385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f3cb-ac03-4b5d-af2d-e702d4b59311 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:00.612655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f3cb-ac03-4b5d-af2d-e702d4b59311 None admin] PATH_INFO: `/v3/services` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:00.613295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4f3cb-ac03-4b5d-af2d-e702d4b59311 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:16:00.613598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4f3cb-ac03-4b5d-af2d-e702d4b59311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:00.614950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4f3cb-ac03-4b5d-af2d-e702d4b59311 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:00.619245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 652/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Thu Sep 22 18:16:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:16:02.757544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85db6a-fdce-4797-9808-f087846035cf None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:02.758074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85db6a-fdce-4797-9808-f087846035cf None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:02.758074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85db6a-fdce-4797-9808-f087846035cf None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:02.759410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 641/1293] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:16:02.764952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f1859-aa2a-46f6-aa78-223d4294900e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:02.765412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f1859-aa2a-46f6-aa78-223d4294900e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:02.765527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f1859-aa2a-46f6-aa78-223d4294900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:02.783480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-594f1859-aa2a-46f6-aa78-223d4294900e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:16:02.784701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-594f1859-aa2a-46f6-aa78-223d4294900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:16:02.813606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:16:02.850429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 653/1294] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:16:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 18:16:03.117949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85db6a-fdce-4797-9808-f087846035cf None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:03.148043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:16:03.217480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85db6a-fdce-4797-9808-f087846035cf None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:03.250942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713cc31-6dc0-4bfe-8825-b3599564d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:03.251580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cc31-6dc0-4bfe-8825-b3599564d54e None admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:03.251857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cc31-6dc0-4bfe-8825-b3599564d54e None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:03.252129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cc31-6dc0-4bfe-8825-b3599564d54e None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:03.252781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713cc31-6dc0-4bfe-8825-b3599564d54e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:03.254156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713cc31-6dc0-4bfe-8825-b3599564d54e None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:03.269733 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 642/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Thu Sep 22 18:16:03 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:16:05.463073 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fa98-3a19-4f37-a3e4-ea2970ca2160 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:05.463605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fa98-3a19-4f37-a3e4-ea2970ca2160 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:05.463605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fa98-3a19-4f37-a3e4-ea2970ca2160 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:05.464988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 654/1296] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:16:05.470388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647931c-c7a1-41e5-9591-afed39a877eb None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:05.470929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647931c-c7a1-41e5-9591-afed39a877eb None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:05.470929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647931c-c7a1-41e5-9591-afed39a877eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:05.489566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2647931c-c7a1-41e5-9591-afed39a877eb None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:16:05.490774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2647931c-c7a1-41e5-9591-afed39a877eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:16:05.561669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 643/1297] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:16:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:16:05.832828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fa98-3a19-4f37-a3e4-ea2970ca2160 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:05.933126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fa98-3a19-4f37-a3e4-ea2970ca2160 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:05.965350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1768c80-bee2-411e-b156-5648abb63313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:05.965978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1768c80-bee2-411e-b156-5648abb63313 None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:05.966263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1768c80-bee2-411e-b156-5648abb63313 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:05.966539 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1768c80-bee2-411e-b156-5648abb63313 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:05.967118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1768c80-bee2-411e-b156-5648abb63313 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:05.968486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1768c80-bee2-411e-b156-5648abb63313 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-d1768c80-bee2-411e-b156-5648abb63313 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:16:05.978517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:16:05.979855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:16:05.980924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 655/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:16:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:16:05.986285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647931c-c7a1-41e5-9591-afed39a877eb None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:06.004322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:16:06.084230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647931c-c7a1-41e5-9591-afed39a877eb None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:06.119111 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a86daf-4797-4af8-8fd1-62d12683ecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:06.119726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a86daf-4797-4af8-8fd1-62d12683ecef None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:06.120009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a86daf-4797-4af8-8fd1-62d12683ecef None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:06.120284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a86daf-4797-4af8-8fd1-62d12683ecef None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:06.120912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a86daf-4797-4af8-8fd1-62d12683ecef None admin] RBAC: Adding query filter params (name=placement) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:16:06.121215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a86daf-4797-4af8-8fd1-62d12683ecef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:06.122602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a86daf-4797-4af8-8fd1-62d12683ecef None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:06.127629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 644/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Thu Sep 22 18:16:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:16:06.133634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1768c80-bee2-411e-b156-5648abb63313 None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:06.164930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:16:06.233008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1768c80-bee2-411e-b156-5648abb63313 None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:06.266457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e008a-d38a-40d7-8e2e-b921e4b6ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:06.267068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e008a-d38a-40d7-8e2e-b921e4b6ee3d None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:06.267350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e008a-d38a-40d7-8e2e-b921e4b6ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:06.267623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e008a-d38a-40d7-8e2e-b921e4b6ee3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:06.268319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e008a-d38a-40d7-8e2e-b921e4b6ee3d None admin] RBAC: Adding query filter params (interface=public, service_id=2a23832e8fe248c68751993d95f39ad7, region_id=RegionOne) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:16:06.268627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e008a-d38a-40d7-8e2e-b921e4b6ee3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:06.270080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e008a-d38a-40d7-8e2e-b921e4b6ee3d None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:06.275037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 656/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Thu Sep 22 18:16:06 2022] GET /identity/v3/endpoints?service_id=2a23832e8fe248c68751993d95f39ad7&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:16:06.280767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a86daf-4797-4af8-8fd1-62d12683ecef None admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:06.361431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:16:06.380125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a86daf-4797-4af8-8fd1-62d12683ecef None admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:06.412788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917f3bf-e403-404b-8174-c8356d51729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:06.413422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f3bf-e403-404b-8174-c8356d51729b None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:06.413706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f3bf-e403-404b-8174-c8356d51729b None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:06.413982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f3bf-e403-404b-8174-c8356d51729b None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:06.414588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917f3bf-e403-404b-8174-c8356d51729b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:06.415962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917f3bf-e403-404b-8174-c8356d51729b None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:06.422534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 645/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Thu Sep 22 18:16:06 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:16:08.567039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d566638-59c3-4042-a4d7-e6e30d81ca37 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:08.567575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d566638-59c3-4042-a4d7-e6e30d81ca37 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:08.567575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d566638-59c3-4042-a4d7-e6e30d81ca37 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:08.568902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 657/1302] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:16:08.574172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571a02-8933-4565-a0a9-a2670a0536f4 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:08.574603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571a02-8933-4565-a0a9-a2670a0536f4 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:08.574707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571a02-8933-4565-a0a9-a2670a0536f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:08.593439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8e571a02-8933-4565-a0a9-a2670a0536f4 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:16:08.594633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8e571a02-8933-4565-a0a9-a2670a0536f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:16:08.660765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 646/1303] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:16:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 18:16:08.924456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d566638-59c3-4042-a4d7-e6e30d81ca37 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:09.019480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:16:09.026731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d566638-59c3-4042-a4d7-e6e30d81ca37 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:09.059020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc135-58e3-43f4-9d1f-1c9de1e7151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:09.059648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc135-58e3-43f4-9d1f-1c9de1e7151c None admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:09.059927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc135-58e3-43f4-9d1f-1c9de1e7151c None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:09.060197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc135-58e3-43f4-9d1f-1c9de1e7151c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:09.060802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bc135-58e3-43f4-9d1f-1c9de1e7151c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:09.062218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bc135-58e3-43f4-9d1f-1c9de1e7151c None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application [None req-bc0bc135-58e3-43f4-9d1f-1c9de1e7151c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 18:16:09.071346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 18:16:09.072516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application with Lock( Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self._enter() Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application return self.creator() Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application created_value = creator( Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: ERROR keystone.server.flask.application Sep 22 18:16:09.073587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 658/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Thu Sep 22 18:16:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 18:16:09.078467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571a02-8933-4565-a0a9-a2670a0536f4 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:09.151887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:16:09.176354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571a02-8933-4565-a0a9-a2670a0536f4 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:09.210184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b3d28-692d-41b1-8524-f0a68fae6e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:09.210795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b3d28-692d-41b1-8524-f0a68fae6e51 None admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:09.211071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b3d28-692d-41b1-8524-f0a68fae6e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:09.211345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b3d28-692d-41b1-8524-f0a68fae6e51 None admin] PATH_INFO: `/v3/services` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:09.211981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b3d28-692d-41b1-8524-f0a68fae6e51 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:16:09.212279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b3d28-692d-41b1-8524-f0a68fae6e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:09.213691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b3d28-692d-41b1-8524-f0a68fae6e51 None admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:09.218709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 647/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Thu Sep 22 18:16:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:16:09.225466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc135-58e3-43f4-9d1f-1c9de1e7151c None admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:16:09.322697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc135-58e3-43f4-9d1f-1c9de1e7151c None admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:16:09.356443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7110e8f-dae5-4217-b3a6-c7a30b6a06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:16:09.357041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7110e8f-dae5-4217-b3a6-c7a30b6a06d0 None admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:16:09.357350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7110e8f-dae5-4217-b3a6-c7a30b6a06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:16:09.357623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7110e8f-dae5-4217-b3a6-c7a30b6a06d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:16:09.358283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7110e8f-dae5-4217-b3a6-c7a30b6a06d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:16:09.359628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7110e8f-dae5-4217-b3a6-c7a30b6a06d0 None admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:16:09.378514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 659/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:16:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:16:19.215715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=30 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:16:19.374098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:15.304590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fefc10-4325-46b1-ba2c-5d156d6b7750 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:15.305593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fefc10-4325-46b1-ba2c-5d156d6b7750 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:15.306022 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fefc10-4325-46b1-ba2c-5d156d6b7750 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:15.308069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 648/1307] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:17:15.313784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8364e-2460-4cfe-98ee-6a360f0dcfda None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:15.314350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8364e-2460-4cfe-98ee-6a360f0dcfda None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:15.314350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8364e-2460-4cfe-98ee-6a360f0dcfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:15.488318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f0c8364e-2460-4cfe-98ee-6a360f0dcfda None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:15.490381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f0c8364e-2460-4cfe-98ee-6a360f0dcfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:15.683006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 660/1308] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:15.988376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfd21-c6d6-4802-9acd-b38b623e9365 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:15.988792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfd21-c6d6-4802-9acd-b38b623e9365 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:15.989135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfd21-c6d6-4802-9acd-b38b623e9365 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:15.990788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 649/1309] 10.222.0.61 () {54 vars in 964 bytes} [Thu Sep 22 18:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:15.999858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d21827-1ef6-44f6-a0fe-c7381b7c0559 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:16.000178 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d21827-1ef6-44f6-a0fe-c7381b7c0559 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:16.000418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d21827-1ef6-44f6-a0fe-c7381b7c0559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:16.092459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-81d21827-1ef6-44f6-a0fe-c7381b7c0559 None None] MFA Rules not processed for user `8d0b8fc336694043a34f007b78c45c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:16.093922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-81d21827-1ef6-44f6-a0fe-c7381b7c0559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:16.126330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:16.190581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 661/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Thu Sep 22 18:17:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:16.199606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dfd21-c6d6-4802-9acd-b38b623e9365 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:16.201418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1b0dfd21-c6d6-4802-9acd-b38b623e9365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:16.317995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dfd21-c6d6-4802-9acd-b38b623e9365 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:16.398477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51a98a-1c97-4137-9692-f35387288cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:16.399003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51a98a-1c97-4137-9692-f35387288cbd service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:16.399279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51a98a-1c97-4137-9692-f35387288cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:16.399545 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51a98a-1c97-4137-9692-f35387288cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:16.401227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6d51a98a-1c97-4137-9692-f35387288cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:16.458991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:16.517660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51a98a-1c97-4137-9692-f35387288cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:16.519152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51a98a-1c97-4137-9692-f35387288cbd service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:16.540107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 650/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:17:19.108971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba54fc-1dda-46b1-83a6-14366c2b0c70 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:19.109512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba54fc-1dda-46b1-83a6-14366c2b0c70 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:19.109512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba54fc-1dda-46b1-83a6-14366c2b0c70 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:19.110827 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 662/1312] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:19.116799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d8798-adea-4cd2-b3e6-bf39640d7ed9 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:19.117220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d8798-adea-4cd2-b3e6-bf39640d7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:19.117384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d8798-adea-4cd2-b3e6-bf39640d7ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:19.190610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6c8d8798-adea-4cd2-b3e6-bf39640d7ed9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:19.191836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6c8d8798-adea-4cd2-b3e6-bf39640d7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:19.303595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 651/1313] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:19.605868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089f250-2a7c-4fe8-96cb-8dae216bf626 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:19.606190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089f250-2a7c-4fe8-96cb-8dae216bf626 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:19.606473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089f250-2a7c-4fe8-96cb-8dae216bf626 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:19.607885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 663/1314] 10.222.0.61 () {54 vars in 964 bytes} [Thu Sep 22 18:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:19.615037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ec1d5-8441-4a3c-851c-9546a6240000 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:19.615326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ec1d5-8441-4a3c-851c-9546a6240000 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:19.615596 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ec1d5-8441-4a3c-851c-9546a6240000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:19.628409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:19.712234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-760ec1d5-8441-4a3c-851c-9546a6240000 None None] MFA Rules not processed for user `8d0b8fc336694043a34f007b78c45c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:19.713465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-760ec1d5-8441-4a3c-851c-9546a6240000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:19.797370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 652/1315] 10.222.0.61 () {58 vars in 1061 bytes} [Thu Sep 22 18:17:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:19.807188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089f250-2a7c-4fe8-96cb-8dae216bf626 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:19.808930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e089f250-2a7c-4fe8-96cb-8dae216bf626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:19.942197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089f250-2a7c-4fe8-96cb-8dae216bf626 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:20.018652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:20.021207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1896bfd-9702-4584-9e70-aa1f0ce3a8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:20.022064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1896bfd-9702-4584-9e70-aa1f0ce3a8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:20.022515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1896bfd-9702-4584-9e70-aa1f0ce3a8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:20.022980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1896bfd-9702-4584-9e70-aa1f0ce3a8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:20.024643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e1896bfd-9702-4584-9e70-aa1f0ce3a8f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:20.147983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1896bfd-9702-4584-9e70-aa1f0ce3a8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:20.149471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1896bfd-9702-4584-9e70-aa1f0ce3a8f6 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:20.169803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 664/1316] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:22.935276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177846f4-8b03-4cf8-b2f7-818f8a82c89e None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:22.935784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177846f4-8b03-4cf8-b2f7-818f8a82c89e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:22.935784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177846f4-8b03-4cf8-b2f7-818f8a82c89e None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:22.937097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 653/1317] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:22.942479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd795-c0f8-4e2d-b9bf-d316df547422 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:22.942891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd795-c0f8-4e2d-b9bf-d316df547422 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:22.943014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd795-c0f8-4e2d-b9bf-d316df547422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:23.009369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-8b8fd795-c0f8-4e2d-b9bf-d316df547422 None None] MFA Rules not processed for user `2e5c72c28f2c4b5fbd6dab7c0388fba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:23.010610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8b8fd795-c0f8-4e2d-b9bf-d316df547422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:23.061425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:23.107125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 665/1318] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:17:23.393915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177846f4-8b03-4cf8-b2f7-818f8a82c89e None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:23.395506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-177846f4-8b03-4cf8-b2f7-818f8a82c89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:23.503074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177846f4-8b03-4cf8-b2f7-818f8a82c89e None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:23.505946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:23.579372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a69b32-5f67-4989-a9ab-d0061521885d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:23.579986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a69b32-5f67-4989-a9ab-d0061521885d service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:23.580269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a69b32-5f67-4989-a9ab-d0061521885d service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:23.580574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a69b32-5f67-4989-a9ab-d0061521885d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:23.582233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d0a69b32-5f67-4989-a9ab-d0061521885d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:23.691445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a69b32-5f67-4989-a9ab-d0061521885d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:23.692884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a69b32-5f67-4989-a9ab-d0061521885d service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:23.711586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 654/1319] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:26.427977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c95d9a-73ec-4601-8f13-6b2a9f7e7283 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:26.428566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c95d9a-73ec-4601-8f13-6b2a9f7e7283 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:26.428566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c95d9a-73ec-4601-8f13-6b2a9f7e7283 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:26.429936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 666/1320] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:26.435157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b5aff-2362-4507-a200-e0ef1c3d42ac None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:26.435607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b5aff-2362-4507-a200-e0ef1c3d42ac None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:26.435745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b5aff-2362-4507-a200-e0ef1c3d42ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:26.477103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:26.503852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d88b5aff-2362-4507-a200-e0ef1c3d42ac None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:26.505076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d88b5aff-2362-4507-a200-e0ef1c3d42ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:26.604740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 655/1321] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:26.890658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c95d9a-73ec-4601-8f13-6b2a9f7e7283 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:26.893107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c7c95d9a-73ec-4601-8f13-6b2a9f7e7283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:27.003387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c95d9a-73ec-4601-8f13-6b2a9f7e7283 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:27.077424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d2fce-dbc3-46ca-bdb0-9006876ad58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:27.078036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d2fce-dbc3-46ca-bdb0-9006876ad58a service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:27.078318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d2fce-dbc3-46ca-bdb0-9006876ad58a service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:27.078596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d2fce-dbc3-46ca-bdb0-9006876ad58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:27.080220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-605d2fce-dbc3-46ca-bdb0-9006876ad58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:27.087097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:27.192781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d2fce-dbc3-46ca-bdb0-9006876ad58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:27.194264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d2fce-dbc3-46ca-bdb0-9006876ad58a service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:27.212553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 667/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:30.093184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e4e15-86d3-4ade-b9d8-83d8549071ae None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:30.093714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e4e15-86d3-4ade-b9d8-83d8549071ae None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:30.093714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e4e15-86d3-4ade-b9d8-83d8549071ae None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:30.095063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 656/1323] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:30.100424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16b35-4bea-4eec-98b2-92ed46d491c7 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:30.101096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16b35-4bea-4eec-98b2-92ed46d491c7 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:30.101230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16b35-4bea-4eec-98b2-92ed46d491c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:30.173599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-e4d16b35-4bea-4eec-98b2-92ed46d491c7 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:30.175451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e4d16b35-4bea-4eec-98b2-92ed46d491c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:30.239367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:30.290867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 668/1324] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:30.568809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e4e15-86d3-4ade-b9d8-83d8549071ae None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:30.570435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c22e4e15-86d3-4ade-b9d8-83d8549071ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:30.677857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e4e15-86d3-4ade-b9d8-83d8549071ae None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:30.691549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:30.756331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6d7da-8d8d-439c-b24a-73cee3ce24af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:30.756954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6d7da-8d8d-439c-b24a-73cee3ce24af service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:30.757263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6d7da-8d8d-439c-b24a-73cee3ce24af service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:30.757569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6d7da-8d8d-439c-b24a-73cee3ce24af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:30.759331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-97c6d7da-8d8d-439c-b24a-73cee3ce24af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:30.871605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6d7da-8d8d-439c-b24a-73cee3ce24af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:30.873042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6d7da-8d8d-439c-b24a-73cee3ce24af service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:30.892505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 657/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:33.199972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781366dd-e23c-40a9-a8e2-10c858a5c12b None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:33.200785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781366dd-e23c-40a9-a8e2-10c858a5c12b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:33.200785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781366dd-e23c-40a9-a8e2-10c858a5c12b None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:33.201936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 669/1326] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:33.208876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ee9f-9313-4046-a8c5-82901cb83298 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:33.209455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ee9f-9313-4046-a8c5-82901cb83298 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:33.209943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ee9f-9313-4046-a8c5-82901cb83298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:33.306404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:33.327205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2c87ee9f-9313-4046-a8c5-82901cb83298 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:33.328426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2c87ee9f-9313-4046-a8c5-82901cb83298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:33.436194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 658/1327] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:33.717090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781366dd-e23c-40a9-a8e2-10c858a5c12b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:33.718706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-781366dd-e23c-40a9-a8e2-10c858a5c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:33.834690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781366dd-e23c-40a9-a8e2-10c858a5c12b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:33.921167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93c5b1-864b-4ee0-b105-4cb4eafd6a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:33.921809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c5b1-864b-4ee0-b105-4cb4eafd6a59 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:33.922088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c5b1-864b-4ee0-b105-4cb4eafd6a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:33.922360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c5b1-864b-4ee0-b105-4cb4eafd6a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:33.924020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8c93c5b1-864b-4ee0-b105-4cb4eafd6a59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:33.943251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:34.048613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93c5b1-864b-4ee0-b105-4cb4eafd6a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:34.050620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93c5b1-864b-4ee0-b105-4cb4eafd6a59 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:34.075990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 670/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:36.332168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7909318-50b7-47b1-ab19-aa603bd1582b None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:36.332751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7909318-50b7-47b1-ab19-aa603bd1582b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:36.332751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7909318-50b7-47b1-ab19-aa603bd1582b None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:36.334016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 659/1329] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:36.339623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690d0bc-ddee-437a-91a2-504100209a00 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:36.340051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690d0bc-ddee-437a-91a2-504100209a00 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:36.340177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690d0bc-ddee-437a-91a2-504100209a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:36.425472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5690d0bc-ddee-437a-91a2-504100209a00 None None] MFA Rules not processed for user `2e5c72c28f2c4b5fbd6dab7c0388fba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:36.426716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5690d0bc-ddee-437a-91a2-504100209a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:36.500020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:36.535047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 671/1330] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:36.821749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7909318-50b7-47b1-ab19-aa603bd1582b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:36.823321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d7909318-50b7-47b1-ab19-aa603bd1582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:36.933438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7909318-50b7-47b1-ab19-aa603bd1582b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:36.955569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:37.011251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152207b1-55fd-4329-bbe2-9636c0ed75ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:37.011869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152207b1-55fd-4329-bbe2-9636c0ed75ed service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:37.012154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152207b1-55fd-4329-bbe2-9636c0ed75ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:37.012428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152207b1-55fd-4329-bbe2-9636c0ed75ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:37.014377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-152207b1-55fd-4329-bbe2-9636c0ed75ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:37.131543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152207b1-55fd-4329-bbe2-9636c0ed75ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:37.132976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152207b1-55fd-4329-bbe2-9636c0ed75ed service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:37.151794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 660/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:39.575859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93069a8-7384-4276-86b0-459c77ffc78e None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:39.576422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93069a8-7384-4276-86b0-459c77ffc78e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:39.576422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93069a8-7384-4276-86b0-459c77ffc78e None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:39.577818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 672/1332] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:39.583922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916a0a5-b4a1-49c0-b981-5d56ba9cfdb6 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:39.584353 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916a0a5-b4a1-49c0-b981-5d56ba9cfdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:39.584512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916a0a5-b4a1-49c0-b981-5d56ba9cfdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:39.647555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:39.650176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2916a0a5-b4a1-49c0-b981-5d56ba9cfdb6 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:39.651971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2916a0a5-b4a1-49c0-b981-5d56ba9cfdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:39.750409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 661/1333] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:40.036721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93069a8-7384-4276-86b0-459c77ffc78e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:40.038478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e93069a8-7384-4276-86b0-459c77ffc78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:40.141315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93069a8-7384-4276-86b0-459c77ffc78e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:40.214308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9747da4-9d73-4b82-bf02-d26edb2e756d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:40.214917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9747da4-9d73-4b82-bf02-d26edb2e756d service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:40.215197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9747da4-9d73-4b82-bf02-d26edb2e756d service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:40.215467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9747da4-9d73-4b82-bf02-d26edb2e756d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:40.217044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f9747da4-9d73-4b82-bf02-d26edb2e756d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:40.244397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:40.326703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9747da4-9d73-4b82-bf02-d26edb2e756d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:40.328052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9747da4-9d73-4b82-bf02-d26edb2e756d service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:40.347002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 673/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:42.564978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840744-77ce-4367-be91-8b8e3da05699 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:42.565830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840744-77ce-4367-be91-8b8e3da05699 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:42.565830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840744-77ce-4367-be91-8b8e3da05699 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:42.567665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 662/1335] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:42.573208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2664ab-8faf-4110-946e-3b1ad2ec44a8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:42.573677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2664ab-8faf-4110-946e-3b1ad2ec44a8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:42.573945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2664ab-8faf-4110-946e-3b1ad2ec44a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:42.640065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-8d2664ab-8faf-4110-946e-3b1ad2ec44a8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:42.641182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8d2664ab-8faf-4110-946e-3b1ad2ec44a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:42.715531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:42.740661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 674/1336] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:17:43.021038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07840744-77ce-4367-be91-8b8e3da05699 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:43.022618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-07840744-77ce-4367-be91-8b8e3da05699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:43.132219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07840744-77ce-4367-be91-8b8e3da05699 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:43.161389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:43.207773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbde14b-49a3-4c64-a536-a6aa80d20ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:43.208413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbde14b-49a3-4c64-a536-a6aa80d20ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:43.208695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbde14b-49a3-4c64-a536-a6aa80d20ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:43.208967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbde14b-49a3-4c64-a536-a6aa80d20ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:43.210638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fcbde14b-49a3-4c64-a536-a6aa80d20ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:43.320393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbde14b-49a3-4c64-a536-a6aa80d20ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:43.321793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbde14b-49a3-4c64-a536-a6aa80d20ab3 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:43.340325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 663/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:45.841471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56374b81-ae8b-4843-8e7e-0d6fa828c295 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:45.841964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56374b81-ae8b-4843-8e7e-0d6fa828c295 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:45.842063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56374b81-ae8b-4843-8e7e-0d6fa828c295 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:45.843445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 675/1338] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:45.848613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebeeaf-3a43-4d33-bae7-4479ad5ed9db None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:45.849054 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebeeaf-3a43-4d33-bae7-4479ad5ed9db None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:45.849193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebeeaf-3a43-4d33-bae7-4479ad5ed9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:45.915172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-64ebeeaf-3a43-4d33-bae7-4479ad5ed9db None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:45.916380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-64ebeeaf-3a43-4d33-bae7-4479ad5ed9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:45.925220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:46.014619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 664/1339] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:46.297719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56374b81-ae8b-4843-8e7e-0d6fa828c295 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:46.299337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-56374b81-ae8b-4843-8e7e-0d6fa828c295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:46.407832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56374b81-ae8b-4843-8e7e-0d6fa828c295 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:46.479686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8f812-3c64-40ed-af24-4f6d9a0f54a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:46.480288 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8f812-3c64-40ed-af24-4f6d9a0f54a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:46.480564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8f812-3c64-40ed-af24-4f6d9a0f54a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:46.480833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8f812-3c64-40ed-af24-4f6d9a0f54a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:46.482450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-81b8f812-3c64-40ed-af24-4f6d9a0f54a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:46.517320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:46.590193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8f812-3c64-40ed-af24-4f6d9a0f54a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:46.591571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8f812-3c64-40ed-af24-4f6d9a0f54a5 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:46.610028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 676/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:50.719766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e0f22-aa77-4fce-b2e5-ab69db3594f6 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:50.720276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e0f22-aa77-4fce-b2e5-ab69db3594f6 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:50.720419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e0f22-aa77-4fce-b2e5-ab69db3594f6 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:50.726189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 665/1341] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:50.728114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b31fc1-877f-4acf-962e-ca2f50995a6c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:50.728568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b31fc1-877f-4acf-962e-ca2f50995a6c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:50.728663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b31fc1-877f-4acf-962e-ca2f50995a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:50.801880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-66b31fc1-877f-4acf-962e-ca2f50995a6c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:50.803202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-66b31fc1-877f-4acf-962e-ca2f50995a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:50.903729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:50.917380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 677/1342] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:17:51.200744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e0f22-aa77-4fce-b2e5-ab69db3594f6 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:51.202423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-578e0f22-aa77-4fce-b2e5-ab69db3594f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:51.311143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e0f22-aa77-4fce-b2e5-ab69db3594f6 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:51.349534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:51.386529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45443cf2-c28f-4bf8-9ce5-bc9e0373e8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:51.387151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443cf2-c28f-4bf8-9ce5-bc9e0373e8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:51.387434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443cf2-c28f-4bf8-9ce5-bc9e0373e8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:51.387713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443cf2-c28f-4bf8-9ce5-bc9e0373e8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:51.389345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-45443cf2-c28f-4bf8-9ce5-bc9e0373e8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:51.498466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45443cf2-c28f-4bf8-9ce5-bc9e0373e8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:51.499822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45443cf2-c28f-4bf8-9ce5-bc9e0373e8a1 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:51.519187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 666/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:54.367441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda508a-59b7-49df-a368-15e34b0a4b43 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:54.368018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda508a-59b7-49df-a368-15e34b0a4b43 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:54.368018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda508a-59b7-49df-a368-15e34b0a4b43 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:54.369374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 678/1344] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:54.374653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850be52-f91f-4fdb-875b-3d54b4deb129 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:54.375074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850be52-f91f-4fdb-875b-3d54b4deb129 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:54.375223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850be52-f91f-4fdb-875b-3d54b4deb129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:54.443819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8850be52-f91f-4fdb-875b-3d54b4deb129 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:54.445047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8850be52-f91f-4fdb-875b-3d54b4deb129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:54.464262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:54.551414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 667/1345] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:17:54.839824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda508a-59b7-49df-a368-15e34b0a4b43 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:54.841443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2cda508a-59b7-49df-a368-15e34b0a4b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:54.949021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda508a-59b7-49df-a368-15e34b0a4b43 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:17:55.025258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12442c57-fa4a-4757-b6f9-7c8f47c13ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:17:55.025893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12442c57-fa4a-4757-b6f9-7c8f47c13ccd service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:55.026167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12442c57-fa4a-4757-b6f9-7c8f47c13ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:55.026442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12442c57-fa4a-4757-b6f9-7c8f47c13ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:55.028048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-12442c57-fa4a-4757-b6f9-7c8f47c13ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:55.075398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:55.142398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12442c57-fa4a-4757-b6f9-7c8f47c13ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:17:55.143832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12442c57-fa4a-4757-b6f9-7c8f47c13ccd service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:17:55.164735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 679/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:17:59.386521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fadc9-1694-4d2b-8a92-b1050ab7c5bd None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:59.387065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fadc9-1694-4d2b-8a92-b1050ab7c5bd None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:59.387065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fadc9-1694-4d2b-8a92-b1050ab7c5bd None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:59.388496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 668/1347] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:17:59.394287 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9efc5-925e-4ea4-a820-894893e236cb None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:17:59.394789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9efc5-925e-4ea4-a820-894893e236cb None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:17:59.394953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9efc5-925e-4ea4-a820-894893e236cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:17:59.460873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-eff9efc5-925e-4ea4-a820-894893e236cb None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:17:59.462126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-eff9efc5-925e-4ea4-a820-894893e236cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:59.564987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:17:59.567729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 680/1348] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:17:59.851911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fadc9-1694-4d2b-8a92-b1050ab7c5bd None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:17:59.853748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-139fadc9-1694-4d2b-8a92-b1050ab7c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:17:59.955822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fadc9-1694-4d2b-8a92-b1050ab7c5bd None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:00.003366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:00.030477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb52ad-dbb1-428f-951b-0dec7d71c99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:00.031086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb52ad-dbb1-428f-951b-0dec7d71c99f service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:00.031368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb52ad-dbb1-428f-951b-0dec7d71c99f service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:00.031643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb52ad-dbb1-428f-951b-0dec7d71c99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:00.033265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2ffb52ad-dbb1-428f-951b-0dec7d71c99f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:00.141127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb52ad-dbb1-428f-951b-0dec7d71c99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:00.142598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb52ad-dbb1-428f-951b-0dec7d71c99f service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:00.160410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 669/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:18:05.125456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f5de1-8462-4e0c-a6d8-0c98bb166771 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:05.126461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f5de1-8462-4e0c-a6d8-0c98bb166771 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:05.126741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f5de1-8462-4e0c-a6d8-0c98bb166771 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:05.128815 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 681/1350] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:05.133930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5152-7310-4543-b1df-b7c55c871be0 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:05.134379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5152-7310-4543-b1df-b7c55c871be0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:05.134468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5152-7310-4543-b1df-b7c55c871be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:05.247466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e76c5152-7310-4543-b1df-b7c55c871be0 None None] MFA Rules not processed for user `e42268a8b5944cbd9508a07c037112e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:05.248685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e76c5152-7310-4543-b1df-b7c55c871be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:05.279374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:05.458228 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 670/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:18:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:09.693396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e8d6-3c40-4743-bf9e-94b9d9e0390b None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:09.693887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e8d6-3c40-4743-bf9e-94b9d9e0390b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:09.693887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e8d6-3c40-4743-bf9e-94b9d9e0390b None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:09.695409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 682/1352] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:09.700654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c707eba-5298-4a38-bd56-f0753ffbfe04 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:09.701491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c707eba-5298-4a38-bd56-f0753ffbfe04 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:09.701989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c707eba-5298-4a38-bd56-f0753ffbfe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:09.788869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6c707eba-5298-4a38-bd56-f0753ffbfe04 None None] MFA Rules not processed for user `e42268a8b5944cbd9508a07c037112e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:09.790504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6c707eba-5298-4a38-bd56-f0753ffbfe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:09.871758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:09.919866 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 671/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:18:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:11.152289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac31555-bce6-4d58-9a52-cc7fafcadd59 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:11.152908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac31555-bce6-4d58-9a52-cc7fafcadd59 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:11.152908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac31555-bce6-4d58-9a52-cc7fafcadd59 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:11.154354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 683/1354] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:11.159552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb0654-7ee0-4db6-a6b0-42101c72bb00 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:11.159983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb0654-7ee0-4db6-a6b0-42101c72bb00 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:11.160106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb0654-7ee0-4db6-a6b0-42101c72bb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:11.239558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d7bb0654-7ee0-4db6-a6b0-42101c72bb00 None None] MFA Rules not processed for user `e42268a8b5944cbd9508a07c037112e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:11.240764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d7bb0654-7ee0-4db6-a6b0-42101c72bb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:11.357111 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 672/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:18:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:18:14.951538 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc018-dbe8-429b-88c2-d92a9697f669 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:14.952421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc018-dbe8-429b-88c2-d92a9697f669 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:14.952701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc018-dbe8-429b-88c2-d92a9697f669 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:14.954088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 684/1356] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:14.960223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacbd9f-6710-42e8-b16c-07994b67b109 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:14.960674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacbd9f-6710-42e8-b16c-07994b67b109 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:14.960795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacbd9f-6710-42e8-b16c-07994b67b109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:15.008934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:15.043918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1bacbd9f-6710-42e8-b16c-07994b67b109 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:15.045223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1bacbd9f-6710-42e8-b16c-07994b67b109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:15.149736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 673/1357] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:15.465891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c833ef7-603c-442b-b20a-58cf232af658 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:15.466189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c833ef7-603c-442b-b20a-58cf232af658 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:15.466474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c833ef7-603c-442b-b20a-58cf232af658 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:15.467818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 685/1358] 10.222.0.61 () {54 vars in 961 bytes} [Thu Sep 22 18:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:15.488870 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df54476-d830-4f56-9835-9f30dafffb48 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:15.489200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df54476-d830-4f56-9835-9f30dafffb48 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:15.489507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df54476-d830-4f56-9835-9f30dafffb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:15.573864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3df54476-d830-4f56-9835-9f30dafffb48 None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:15.575278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3df54476-d830-4f56-9835-9f30dafffb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:15.627013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:15.720441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 674/1359] 10.222.0.61 () {58 vars in 1058 bytes} [Thu Sep 22 18:18:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:15.728535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c833ef7-603c-442b-b20a-58cf232af658 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:15.730484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7c833ef7-603c-442b-b20a-58cf232af658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:15.909247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c833ef7-603c-442b-b20a-58cf232af658 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:15.987868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:16.030631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0bbe-0f34-4714-8272-ab17cb089c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:16.031398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0bbe-0f34-4714-8272-ab17cb089c71 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:16.031781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0bbe-0f34-4714-8272-ab17cb089c71 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:16.032159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0bbe-0f34-4714-8272-ab17cb089c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:16.033925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-083e0bbe-0f34-4714-8272-ab17cb089c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:16.139807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e0bbe-0f34-4714-8272-ab17cb089c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:16.141656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e0bbe-0f34-4714-8272-ab17cb089c71 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:16.162752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 686/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:18.572114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e07a-62b2-4c7f-bfcd-00cfd4aa3750 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:18.572114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e07a-62b2-4c7f-bfcd-00cfd4aa3750 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:18.572114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e07a-62b2-4c7f-bfcd-00cfd4aa3750 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:18.583255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa17f4b-b4fe-483f-bae3-6abe464d218c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:18.583255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa17f4b-b4fe-483f-bae3-6abe464d218c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:18.583255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa17f4b-b4fe-483f-bae3-6abe464d218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:18.585267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 675/1361] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:18.650347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-2aa17f4b-b4fe-483f-bae3-6abe464d218c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:18.651571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2aa17f4b-b4fe-483f-bae3-6abe464d218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:18.698285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:18.765277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 687/1362] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:19.057643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e07a-62b2-4c7f-bfcd-00cfd4aa3750 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:19.059692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5339e07a-62b2-4c7f-bfcd-00cfd4aa3750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:19.247111 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e07a-62b2-4c7f-bfcd-00cfd4aa3750 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:19.259268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:19.408960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad5598-4349-4892-8d3a-22f8cd3208a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:19.409627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad5598-4349-4892-8d3a-22f8cd3208a1 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:19.410139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad5598-4349-4892-8d3a-22f8cd3208a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:19.410407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad5598-4349-4892-8d3a-22f8cd3208a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:19.412133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9cad5598-4349-4892-8d3a-22f8cd3208a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:19.510860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad5598-4349-4892-8d3a-22f8cd3208a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:19.512558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad5598-4349-4892-8d3a-22f8cd3208a1 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:19.532164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 676/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:22.063078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ac4f1-b7ad-4908-88dc-7cfeed1743c5 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:22.063656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ac4f1-b7ad-4908-88dc-7cfeed1743c5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:22.063884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ac4f1-b7ad-4908-88dc-7cfeed1743c5 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:22.065359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 688/1364] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:22.071357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2f186-a13c-437d-a90c-d71ac37d9438 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:22.071786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2f186-a13c-437d-a90c-d71ac37d9438 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:22.071900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2f186-a13c-437d-a90c-d71ac37d9438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:22.088860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:22.147681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4fa2f186-a13c-437d-a90c-d71ac37d9438 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:22.149029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4fa2f186-a13c-437d-a90c-d71ac37d9438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:22.252004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 677/1365] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:18:22.542681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91d2e3-b29c-4203-8512-42f88e333728 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:22.542974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91d2e3-b29c-4203-8512-42f88e333728 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:22.543277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91d2e3-b29c-4203-8512-42f88e333728 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:22.544848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 689/1366] 10.222.0.61 () {54 vars in 961 bytes} [Thu Sep 22 18:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:22.550862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8e6f7-d622-4068-8c44-49472f624cdb None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:22.551146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8e6f7-d622-4068-8c44-49472f624cdb None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:22.551422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8e6f7-d622-4068-8c44-49472f624cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:22.632958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-33e8e6f7-d622-4068-8c44-49472f624cdb None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:22.634200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-33e8e6f7-d622-4068-8c44-49472f624cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:22.681064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:22.771445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 678/1367] 10.222.0.61 () {58 vars in 1058 bytes} [Thu Sep 22 18:18:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:22.779419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91d2e3-b29c-4203-8512-42f88e333728 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:22.781153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1b91d2e3-b29c-4203-8512-42f88e333728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:22.947086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91d2e3-b29c-4203-8512-42f88e333728 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:22.969786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:23.079388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf400c7d-1f30-463a-93f8-acc4c1641ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:23.080101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf400c7d-1f30-463a-93f8-acc4c1641ab6 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:23.080293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf400c7d-1f30-463a-93f8-acc4c1641ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:23.080564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf400c7d-1f30-463a-93f8-acc4c1641ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:23.083051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-cf400c7d-1f30-463a-93f8-acc4c1641ab6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:23.177488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f74c88-1e9b-41c4-9343-43efbf2b5e3c None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:23.178065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f74c88-1e9b-41c4-9343-43efbf2b5e3c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:23.178065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f74c88-1e9b-41c4-9343-43efbf2b5e3c None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:23.179532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 679/1368] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:18:23.184644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf881ec-25c2-4517-8b4b-dc9abb7e2ee1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:23.184954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf881ec-25c2-4517-8b4b-dc9abb7e2ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:23.185203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf881ec-25c2-4517-8b4b-dc9abb7e2ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:23.192852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf400c7d-1f30-463a-93f8-acc4c1641ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:23.194658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf400c7d-1f30-463a-93f8-acc4c1641ab6 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:23.214838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 690/1369] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:23.268154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ecf881ec-25c2-4517-8b4b-dc9abb7e2ee1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:23.268154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ecf881ec-25c2-4517-8b4b-dc9abb7e2ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:23.380821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:23.392294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 680/1370] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:18:23.697379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b357-f1e4-452b-986e-aca9986ede5c None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:23.697865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b357-f1e4-452b-986e-aca9986ede5c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:23.698295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b357-f1e4-452b-986e-aca9986ede5c None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:23.699825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 691/1371] 10.222.0.61 () {54 vars in 963 bytes} [Thu Sep 22 18:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:23.705161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b00ba-ca47-4a8b-9ae5-dae14c7830cc None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:23.705676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b00ba-ca47-4a8b-9ae5-dae14c7830cc None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:23.706117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b00ba-ca47-4a8b-9ae5-dae14c7830cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:23.790404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-922b00ba-ca47-4a8b-9ae5-dae14c7830cc None None] MFA Rules not processed for user `465cff05c2ed4fe19e99289379c2966d`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:23.791973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-922b00ba-ca47-4a8b-9ae5-dae14c7830cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:23.875845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 681/1372] 10.222.0.61 () {58 vars in 1060 bytes} [Thu Sep 22 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:23.884237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157b357-f1e4-452b-986e-aca9986ede5c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:23.885822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d157b357-f1e4-452b-986e-aca9986ede5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:23.918470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:24.002967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157b357-f1e4-452b-986e-aca9986ede5c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:24.083803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9fab9-e56c-44ee-819f-8ca277de41b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:24.085223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9fab9-e56c-44ee-819f-8ca277de41b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:24.085632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9fab9-e56c-44ee-819f-8ca277de41b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:24.086006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9fab9-e56c-44ee-819f-8ca277de41b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:24.088009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-56b9fab9-e56c-44ee-819f-8ca277de41b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:24.182083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:24.225333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9fab9-e56c-44ee-819f-8ca277de41b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:24.228942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9fab9-e56c-44ee-819f-8ca277de41b5 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:24.250690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 692/1373] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:18:25.471954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd221d0f-c8aa-48ef-afe7-641fdc35918e None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:25.472540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd221d0f-c8aa-48ef-afe7-641fdc35918e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:25.472540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd221d0f-c8aa-48ef-afe7-641fdc35918e None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:25.474160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 682/1374] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:25.479871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f7c60-5b86-4778-95ae-f1f39604f63f None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:25.480442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f7c60-5b86-4778-95ae-f1f39604f63f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:25.480442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f7c60-5b86-4778-95ae-f1f39604f63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:25.548225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4c8f7c60-5b86-4778-95ae-f1f39604f63f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:25.549477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4c8f7c60-5b86-4778-95ae-f1f39604f63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:25.653588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 693/1375] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:25.947361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd221d0f-c8aa-48ef-afe7-641fdc35918e None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:25.948932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-dd221d0f-c8aa-48ef-afe7-641fdc35918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:26.039045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:26.102675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd221d0f-c8aa-48ef-afe7-641fdc35918e None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:26.241553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953215fa-0b87-4303-afe0-09c2af4a5ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:26.242621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953215fa-0b87-4303-afe0-09c2af4a5ef0 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:26.243124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953215fa-0b87-4303-afe0-09c2af4a5ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:26.243619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953215fa-0b87-4303-afe0-09c2af4a5ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:26.246810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-953215fa-0b87-4303-afe0-09c2af4a5ef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:26.316239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:26.374009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953215fa-0b87-4303-afe0-09c2af4a5ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:26.375720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953215fa-0b87-4303-afe0-09c2af4a5ef0 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:26.402273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 683/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:28.684547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f136e-2467-43ac-b1ca-a69b289a732f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:28.704126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f136e-2467-43ac-b1ca-a69b289a732f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:28.704126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f136e-2467-43ac-b1ca-a69b289a732f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:28.704126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 694/1377] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:28.705035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54747cd-c309-4a6d-a719-68e26737095d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:28.705035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54747cd-c309-4a6d-a719-68e26737095d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:28.705035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54747cd-c309-4a6d-a719-68e26737095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:28.779312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d54747cd-c309-4a6d-a719-68e26737095d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:28.780799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d54747cd-c309-4a6d-a719-68e26737095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:28.890958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 684/1378] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:29.179183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f136e-2467-43ac-b1ca-a69b289a732f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:29.180875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3d9f136e-2467-43ac-b1ca-a69b289a732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:29.223603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:29.356235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f136e-2467-43ac-b1ca-a69b289a732f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:29.488848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:29.495240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083e1e8-c78e-4b8f-9825-307f2b9e6753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:29.496048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083e1e8-c78e-4b8f-9825-307f2b9e6753 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:29.496338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083e1e8-c78e-4b8f-9825-307f2b9e6753 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:29.496610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083e1e8-c78e-4b8f-9825-307f2b9e6753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:29.498383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b083e1e8-c78e-4b8f-9825-307f2b9e6753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:29.610363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083e1e8-c78e-4b8f-9825-307f2b9e6753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:29.612031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083e1e8-c78e-4b8f-9825-307f2b9e6753 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:29.632883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 695/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:18:31.866028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73531ef2-adfd-41a9-b881-9e78cc29cb8a None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:31.866669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73531ef2-adfd-41a9-b881-9e78cc29cb8a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:31.866669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73531ef2-adfd-41a9-b881-9e78cc29cb8a None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:31.874177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c475-9d0b-4758-95d9-bd600410e9c5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:31.875383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c475-9d0b-4758-95d9-bd600410e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:31.875383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c475-9d0b-4758-95d9-bd600410e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:31.878914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 685/1380] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:31.955464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4bd3c475-9d0b-4758-95d9-bd600410e9c5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:31.956632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4bd3c475-9d0b-4758-95d9-bd600410e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:32.030921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:32.067107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 696/1381] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:32.447158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73531ef2-adfd-41a9-b881-9e78cc29cb8a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:32.448768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-73531ef2-adfd-41a9-b881-9e78cc29cb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:32.484481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:32.619352 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73531ef2-adfd-41a9-b881-9e78cc29cb8a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:32.742881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:32.765530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a19b7-c511-4803-96d1-a833fae7e94d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:32.766290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a19b7-c511-4803-96d1-a833fae7e94d service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:32.766667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a19b7-c511-4803-96d1-a833fae7e94d service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:32.767033 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a19b7-c511-4803-96d1-a833fae7e94d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:32.769710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1f7a19b7-c511-4803-96d1-a833fae7e94d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:32.879850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a19b7-c511-4803-96d1-a833fae7e94d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:32.881661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a19b7-c511-4803-96d1-a833fae7e94d service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:32.900451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 686/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:35.165818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9877a8-e825-4c8a-805f-d5964c24a81c None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:35.166671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9877a8-e825-4c8a-805f-d5964c24a81c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:35.166671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9877a8-e825-4c8a-805f-d5964c24a81c None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:35.167738 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 697/1383] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:35.174549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df74b-0cc3-4974-a2da-456d64191827 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:35.175084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df74b-0cc3-4974-a2da-456d64191827 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:35.175084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73df74b-0cc3-4974-a2da-456d64191827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:35.244454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a73df74b-0cc3-4974-a2da-456d64191827 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:35.245616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a73df74b-0cc3-4974-a2da-456d64191827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:35.317428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:35.360216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 687/1384] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:35.644601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9877a8-e825-4c8a-805f-d5964c24a81c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:35.646181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2d9877a8-e825-4c8a-805f-d5964c24a81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:35.816174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9877a8-e825-4c8a-805f-d5964c24a81c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:35.870827 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:35.933972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff530c98-bde6-487b-bfd5-cef23dabd899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:35.934553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff530c98-bde6-487b-bfd5-cef23dabd899 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:35.934833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff530c98-bde6-487b-bfd5-cef23dabd899 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:35.935121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff530c98-bde6-487b-bfd5-cef23dabd899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:35.936742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ff530c98-bde6-487b-bfd5-cef23dabd899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:36.045840 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff530c98-bde6-487b-bfd5-cef23dabd899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:36.047460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff530c98-bde6-487b-bfd5-cef23dabd899 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:36.068680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 698/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:38.250680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de672b1c-980e-41d7-8612-c2d3cbd90840 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:38.251282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de672b1c-980e-41d7-8612-c2d3cbd90840 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:38.251282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de672b1c-980e-41d7-8612-c2d3cbd90840 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:38.252687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 688/1386] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:38.258081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a302c-4f05-4a77-a464-f5b3fbb37e64 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:38.258518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a302c-4f05-4a77-a464-f5b3fbb37e64 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:38.258727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a302c-4f05-4a77-a464-f5b3fbb37e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:38.327640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-bc5a302c-4f05-4a77-a464-f5b3fbb37e64 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:38.328868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bc5a302c-4f05-4a77-a464-f5b3fbb37e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:38.338214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:38.429541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 699/1387] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:38.717569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de672b1c-980e-41d7-8612-c2d3cbd90840 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:38.719104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-de672b1c-980e-41d7-8612-c2d3cbd90840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:38.868047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de672b1c-980e-41d7-8612-c2d3cbd90840 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:38.914819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:38.985775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a5b3c-92b8-4f15-bc63-0be0a5da4b17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:38.987187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5b3c-92b8-4f15-bc63-0be0a5da4b17 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:38.987473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5b3c-92b8-4f15-bc63-0be0a5da4b17 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:38.987745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5b3c-92b8-4f15-bc63-0be0a5da4b17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:38.989401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f43a5b3c-92b8-4f15-bc63-0be0a5da4b17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:39.096245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a5b3c-92b8-4f15-bc63-0be0a5da4b17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:39.097878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a5b3c-92b8-4f15-bc63-0be0a5da4b17 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:39.116984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 689/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:39.755925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ef87-bade-4e35-98b0-c8646a9383b0 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:39.756493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ef87-bade-4e35-98b0-c8646a9383b0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:39.756493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ef87-bade-4e35-98b0-c8646a9383b0 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:39.757858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 700/1389] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:39.763069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1465-8f76-4dbd-a62e-08663d7c0616 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:39.763532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1465-8f76-4dbd-a62e-08663d7c0616 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:39.763643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1465-8f76-4dbd-a62e-08663d7c0616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:39.828863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:39.832844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-78de1465-8f76-4dbd-a62e-08663d7c0616 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:39.834713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-78de1465-8f76-4dbd-a62e-08663d7c0616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:39.937035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 690/1390] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:40.238165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e6197-1a0f-4d28-9281-6dcf9d3e22e0 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:40.238456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e6197-1a0f-4d28-9281-6dcf9d3e22e0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:40.238761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e6197-1a0f-4d28-9281-6dcf9d3e22e0 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:40.240344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 701/1391] 10.222.0.61 () {54 vars in 962 bytes} [Thu Sep 22 18:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:40.245954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f8fc-b162-4aad-a76c-ac229be2b1d1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:40.246306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f8fc-b162-4aad-a76c-ac229be2b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:40.246646 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f8fc-b162-4aad-a76c-ac229be2b1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:40.325699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d221f8fc-b162-4aad-a76c-ac229be2b1d1 None None] MFA Rules not processed for user `2ab45d09f8724d9ca5b6fb1fa050fdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:40.326946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d221f8fc-b162-4aad-a76c-ac229be2b1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:40.399299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:40.406293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 691/1392] 10.222.0.61 () {58 vars in 1059 bytes} [Thu Sep 22 18:18:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:40.415819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e6197-1a0f-4d28-9281-6dcf9d3e22e0 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:40.417586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a78e6197-1a0f-4d28-9281-6dcf9d3e22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:40.520081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e6197-1a0f-4d28-9281-6dcf9d3e22e0 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:40.557789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:40.596485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab051bd6-edb0-4bfa-9c51-91dac4161b28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab45d09f8724d9ca5b6fb1fa050fdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:40.597099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab051bd6-edb0-4bfa-9c51-91dac4161b28 service glance] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:40.597422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab051bd6-edb0-4bfa-9c51-91dac4161b28 service glance] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:40.597701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab051bd6-edb0-4bfa-9c51-91dac4161b28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:40.599572 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ab051bd6-edb0-4bfa-9c51-91dac4161b28 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:40.719453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab051bd6-edb0-4bfa-9c51-91dac4161b28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:40.721526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab051bd6-edb0-4bfa-9c51-91dac4161b28 service glance] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:40.740427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 702/1393] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:41.340969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239796b-b5d9-45c6-85ae-ceac9701072d None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:41.341584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239796b-b5d9-45c6-85ae-ceac9701072d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:41.341584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239796b-b5d9-45c6-85ae-ceac9701072d None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:41.343535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 692/1394] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:41.349405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4d899-d36d-41f0-b321-cac6e6064602 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:41.350002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4d899-d36d-41f0-b321-cac6e6064602 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:41.350002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4d899-d36d-41f0-b321-cac6e6064602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:41.420465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5fa4d899-d36d-41f0-b321-cac6e6064602 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:41.421664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5fa4d899-d36d-41f0-b321-cac6e6064602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:41.441113 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:41.498395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d8bfd-5531-442b-9106-313e39860640 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:41.498754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d8bfd-5531-442b-9106-313e39860640 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:41.499108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d8bfd-5531-442b-9106-313e39860640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:41.528072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 703/1395] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:41.578262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-db2d8bfd-5531-442b-9106-313e39860640 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:41.579571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-db2d8bfd-5531-442b-9106-313e39860640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:41.668355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 693/1396] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:18:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:41.716704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799f13a-d1d6-416d-9e9a-a55dc620de47 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:41.716995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799f13a-d1d6-416d-9e9a-a55dc620de47 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:41.717314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799f13a-d1d6-416d-9e9a-a55dc620de47 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:41.718679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 704/1397] 10.222.0.61 () {54 vars in 943 bytes} [Thu Sep 22 18:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:18:41.725873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e43cf-e222-47f5-80a5-49bc458ce3bd None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:41.726199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e43cf-e222-47f5-80a5-49bc458ce3bd None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:41.726481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e43cf-e222-47f5-80a5-49bc458ce3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:41.805571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-338e43cf-e222-47f5-80a5-49bc458ce3bd None None] MFA Rules not processed for user `e20585b86c2d45da8ca53fa1db2ccd25`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:41.806799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-338e43cf-e222-47f5-80a5-49bc458ce3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:41.819014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799f13a-d1d6-416d-9e9a-a55dc620de47 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:41.820525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f799f13a-d1d6-416d-9e9a-a55dc620de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:41.836361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:41.920566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 694/1398] 10.222.0.61 () {58 vars in 1040 bytes} [Thu Sep 22 18:18:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:41.930984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e43cf-e222-47f5-80a5-49bc458ce3bd None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:41.944428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e43cf-e222-47f5-80a5-49bc458ce3bd None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:41.977255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799f13a-d1d6-416d-9e9a-a55dc620de47 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:41.980452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:42.061580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac10ad7-79ab-4e26-b186-777fc0dd620f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:42.062258 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac10ad7-79ab-4e26-b186-777fc0dd620f service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:42.062538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac10ad7-79ab-4e26-b186-777fc0dd620f service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:42.062806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac10ad7-79ab-4e26-b186-777fc0dd620f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:42.065098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3ac10ad7-79ab-4e26-b186-777fc0dd620f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:42.096248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bef7a-4f7c-4294-b443-b699c24a2f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:42.096869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bef7a-4f7c-4294-b443-b699c24a2f9a service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:42.097157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bef7a-4f7c-4294-b443-b699c24a2f9a service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:42.097467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bef7a-4f7c-4294-b443-b699c24a2f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:42.099095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b46bef7a-4f7c-4294-b443-b699c24a2f9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:42.101338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:42.156868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac10ad7-79ab-4e26-b186-777fc0dd620f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:42.158484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac10ad7-79ab-4e26-b186-777fc0dd620f service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:42.166884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 695/1399] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:18:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 18:18:42.196060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bef7a-4f7c-4294-b443-b699c24a2f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:42.197958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bef7a-4f7c-4294-b443-b699c24a2f9a service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:42.217934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 705/1400] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:18:44.463125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5445-20e0-4729-91e9-0de0d1416aee None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:44.463676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5445-20e0-4729-91e9-0de0d1416aee None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:44.463676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5445-20e0-4729-91e9-0de0d1416aee None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:44.464947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 696/1401] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:44.470866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd03ea9-f658-44a5-b644-18f9facf1c52 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:44.471567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd03ea9-f658-44a5-b644-18f9facf1c52 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:44.471567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd03ea9-f658-44a5-b644-18f9facf1c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:44.482380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:44.545314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4cd03ea9-f658-44a5-b644-18f9facf1c52 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:44.546590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4cd03ea9-f658-44a5-b644-18f9facf1c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:44.662780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 706/1402] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:44.952195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5445-20e0-4729-91e9-0de0d1416aee None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:44.953532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f6ff5445-20e0-4729-91e9-0de0d1416aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:45.115962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5445-20e0-4729-91e9-0de0d1416aee None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:45.149179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:45.260042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6206016-39a5-4a3a-b4e6-47129a9fdbb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:45.260618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6206016-39a5-4a3a-b4e6-47129a9fdbb2 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:45.260901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6206016-39a5-4a3a-b4e6-47129a9fdbb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:45.261287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6206016-39a5-4a3a-b4e6-47129a9fdbb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:45.262927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a6206016-39a5-4a3a-b4e6-47129a9fdbb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:45.359941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6206016-39a5-4a3a-b4e6-47129a9fdbb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:45.362339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6206016-39a5-4a3a-b4e6-47129a9fdbb2 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:45.386688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 697/1403] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:47.669005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101fa1-944d-4687-8cd3-ff2c91bcfb53 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:47.669532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101fa1-944d-4687-8cd3-ff2c91bcfb53 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:47.669532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff101fa1-944d-4687-8cd3-ff2c91bcfb53 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:47.677824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 707/1404] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:47.679504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3cdca-126a-40c3-bd5e-3f0ea8bba3c5 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:47.679943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3cdca-126a-40c3-bd5e-3f0ea8bba3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:47.680102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3cdca-126a-40c3-bd5e-3f0ea8bba3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:47.730151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:47.759891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-45e3cdca-126a-40c3-bd5e-3f0ea8bba3c5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:47.761227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-45e3cdca-126a-40c3-bd5e-3f0ea8bba3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:47.872937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 698/1405] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:48.172010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101fa1-944d-4687-8cd3-ff2c91bcfb53 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:48.174074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ff101fa1-944d-4687-8cd3-ff2c91bcfb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:48.269993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:48.336563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff101fa1-944d-4687-8cd3-ff2c91bcfb53 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:48.464734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2be2bb-34a9-44ad-9f2f-6d1804c3ebbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:48.465383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2be2bb-34a9-44ad-9f2f-6d1804c3ebbb service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:48.465669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2be2bb-34a9-44ad-9f2f-6d1804c3ebbb service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:48.465946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2be2bb-34a9-44ad-9f2f-6d1804c3ebbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:48.467582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bb2be2bb-34a9-44ad-9f2f-6d1804c3ebbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:48.522883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:48.569719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2be2bb-34a9-44ad-9f2f-6d1804c3ebbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:48.571610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2be2bb-34a9-44ad-9f2f-6d1804c3ebbb service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:48.592666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 708/1406] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:18:50.840342 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d066-2e23-4bc0-af6f-8a28280028bf None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:50.840878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d066-2e23-4bc0-af6f-8a28280028bf None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:50.840878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d066-2e23-4bc0-af6f-8a28280028bf None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:50.842269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 699/1407] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:18:50.847586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e17899-a664-46a2-8693-9956fe898d61 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:50.848020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e17899-a664-46a2-8693-9956fe898d61 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:50.848193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e17899-a664-46a2-8693-9956fe898d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:50.925466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-89e17899-a664-46a2-8693-9956fe898d61 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:18:50.926928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-89e17899-a664-46a2-8693-9956fe898d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:51.032727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 709/1408] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:18:51.325998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30d066-2e23-4bc0-af6f-8a28280028bf None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:18:51.327550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-cf30d066-2e23-4bc0-af6f-8a28280028bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:51.473036 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:51.518811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30d066-2e23-4bc0-af6f-8a28280028bf None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:18:51.648865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb9e82-4276-419b-a984-7258b83f771f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:18:51.649549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb9e82-4276-419b-a984-7258b83f771f service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:18:51.649829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb9e82-4276-419b-a984-7258b83f771f service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:18:51.650101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb9e82-4276-419b-a984-7258b83f771f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:18:51.651738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-daeb9e82-4276-419b-a984-7258b83f771f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:18:51.748048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:18:51.768684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb9e82-4276-419b-a984-7258b83f771f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:18:51.770328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb9e82-4276-419b-a984-7258b83f771f service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:18:51.791401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 700/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:01.030244 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:01.789017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=13 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:05.205734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268636de-3e6b-4675-8511-beca8fcb3248 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:05.206286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268636de-3e6b-4675-8511-beca8fcb3248 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:05.206286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268636de-3e6b-4675-8511-beca8fcb3248 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:05.207648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 710/1410] 10.222.0.61 () {54 vars in 918 bytes} [Thu Sep 22 18:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:05.212888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e159682-2806-4051-8ceb-30d253ceeea7 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:05.213342 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e159682-2806-4051-8ceb-30d253ceeea7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:05.213496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e159682-2806-4051-8ceb-30d253ceeea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:05.293178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6e159682-2806-4051-8ceb-30d253ceeea7 None None] MFA Rules not processed for user `e42268a8b5944cbd9508a07c037112e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:05.294516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6e159682-2806-4051-8ceb-30d253ceeea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:05.399965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 701/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Sep 22 18:19:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:05.415093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04133309-b97f-432a-8f11-b1d3fa22f6ed None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:05.415366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04133309-b97f-432a-8f11-b1d3fa22f6ed None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:05.415642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04133309-b97f-432a-8f11-b1d3fa22f6ed None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:05.416980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 711/1412] 10.222.0.61 () {54 vars in 918 bytes} [Thu Sep 22 18:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:05.421780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aef40a-a05e-4b00-bc49-865463d2e97b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:05.422085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aef40a-a05e-4b00-bc49-865463d2e97b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:05.422363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aef40a-a05e-4b00-bc49-865463d2e97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:05.497137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:05.500932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-08aef40a-a05e-4b00-bc49-865463d2e97b None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:05.502855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-08aef40a-a05e-4b00-bc49-865463d2e97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:05.616786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 702/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Sep 22 18:19:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:08.170389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92f2f9-89d7-470d-8cf8-11c085de8d7a None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:08.170935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92f2f9-89d7-470d-8cf8-11c085de8d7a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:08.170935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92f2f9-89d7-470d-8cf8-11c085de8d7a None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:08.172396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:08.177716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7472-2215-4018-ab1c-4298c83f5658 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:08.178102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7472-2215-4018-ab1c-4298c83f5658 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:08.178269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7472-2215-4018-ab1c-4298c83f5658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:08.245473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-9ffc7472-2215-4018-ab1c-4298c83f5658 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:08.246836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9ffc7472-2215-4018-ab1c-4298c83f5658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:08.303613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:08.346625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:08.638250 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92f2f9-89d7-470d-8cf8-11c085de8d7a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:08.639881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ca92f2f9-89d7-470d-8cf8-11c085de8d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:08.785086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92f2f9-89d7-470d-8cf8-11c085de8d7a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:08.857299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:08.897189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523ac7-3c8f-47e6-b534-086aaa395ebb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:08.897834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523ac7-3c8f-47e6-b534-086aaa395ebb service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:08.898117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523ac7-3c8f-47e6-b534-086aaa395ebb service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:08.898395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523ac7-3c8f-47e6-b534-086aaa395ebb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:08.900038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-80523ac7-3c8f-47e6-b534-086aaa395ebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:08.989718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80523ac7-3c8f-47e6-b534-086aaa395ebb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:08.991232 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80523ac7-3c8f-47e6-b534-086aaa395ebb service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:09.009334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 713/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:10.149728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74a3d-7e8d-4d1f-9241-0fa76c792a61 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:10.150385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74a3d-7e8d-4d1f-9241-0fa76c792a61 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:10.150385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74a3d-7e8d-4d1f-9241-0fa76c792a61 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:10.151613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:10.158101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f01538-5d0e-4063-a8c8-24e15a0b18ef None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:10.158565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f01538-5d0e-4063-a8c8-24e15a0b18ef None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:10.158669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f01538-5d0e-4063-a8c8-24e15a0b18ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:10.236545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-70f01538-5d0e-4063-a8c8-24e15a0b18ef None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:10.237823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-70f01538-5d0e-4063-a8c8-24e15a0b18ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:10.265140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:10.336949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:10.490554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e74a3d-7e8d-4d1f-9241-0fa76c792a61 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:10.492775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f4e74a3d-7e8d-4d1f-9241-0fa76c792a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:10.637967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e74a3d-7e8d-4d1f-9241-0fa76c792a61 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:10.678833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:10.753003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351b18-198a-46bb-a4ae-5e7ec3ebd60d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:10.753643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351b18-198a-46bb-a4ae-5e7ec3ebd60d service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:10.753929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351b18-198a-46bb-a4ae-5e7ec3ebd60d service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:10.754205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351b18-198a-46bb-a4ae-5e7ec3ebd60d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:10.755844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-65351b18-198a-46bb-a4ae-5e7ec3ebd60d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:10.846301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351b18-198a-46bb-a4ae-5e7ec3ebd60d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:10.847886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351b18-198a-46bb-a4ae-5e7ec3ebd60d service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:10.866718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 705/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:12.010166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48ffdf-7b4f-4eb9-aee6-6b0d3b6b0e55 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:12.010741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48ffdf-7b4f-4eb9-aee6-6b0d3b6b0e55 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:12.010741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48ffdf-7b4f-4eb9-aee6-6b0d3b6b0e55 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:12.012076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:12.018560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaa78b-1e04-447b-a5eb-4a018d6b47b7 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:12.018996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaa78b-1e04-447b-a5eb-4a018d6b47b7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:12.019117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaa78b-1e04-447b-a5eb-4a018d6b47b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:12.074969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:12.096873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-0ccaa78b-1e04-447b-a5eb-4a018d6b47b7 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:12.098124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0ccaa78b-1e04-447b-a5eb-4a018d6b47b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:12.199808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:12.349765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48ffdf-7b4f-4eb9-aee6-6b0d3b6b0e55 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:12.351468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1d48ffdf-7b4f-4eb9-aee6-6b0d3b6b0e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:12.496553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48ffdf-7b4f-4eb9-aee6-6b0d3b6b0e55 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:12.508587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:12.609952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc94b-205e-4257-bbc5-8b5b141aabf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:12.610482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc94b-205e-4257-bbc5-8b5b141aabf8 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:12.610766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc94b-205e-4257-bbc5-8b5b141aabf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:12.611040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc94b-205e-4257-bbc5-8b5b141aabf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:12.612648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-39dcc94b-205e-4257-bbc5-8b5b141aabf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:12.704871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc94b-205e-4257-bbc5-8b5b141aabf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:12.706497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc94b-205e-4257-bbc5-8b5b141aabf8 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:12.724874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 716/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:13.832138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412db2-abf2-4e85-a65a-9a8c1a7f8853 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:13.832627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412db2-abf2-4e85-a65a-9a8c1a7f8853 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:13.832627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412db2-abf2-4e85-a65a-9a8c1a7f8853 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:13.834110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:13.840620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1922c-6e7d-4ef9-8ac9-87e81c9f3bf9 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:13.841041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1922c-6e7d-4ef9-8ac9-87e81c9f3bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:13.841183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1922c-6e7d-4ef9-8ac9-87e81c9f3bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:13.862688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:13.919027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-a7e1922c-6e7d-4ef9-8ac9-87e81c9f3bf9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:13.920260 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a7e1922c-6e7d-4ef9-8ac9-87e81c9f3bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:14.016157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:14.166975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc412db2-abf2-4e85-a65a-9a8c1a7f8853 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:14.168572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-dc412db2-abf2-4e85-a65a-9a8c1a7f8853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:14.286551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:14.323947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc412db2-abf2-4e85-a65a-9a8c1a7f8853 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:14.437905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693768f2-d83e-49ba-81f8-a4a303413736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:14.438521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693768f2-d83e-49ba-81f8-a4a303413736 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:14.438801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693768f2-d83e-49ba-81f8-a4a303413736 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:14.439074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693768f2-d83e-49ba-81f8-a4a303413736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:14.440686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-693768f2-d83e-49ba-81f8-a4a303413736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:14.517476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:14.532017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693768f2-d83e-49ba-81f8-a4a303413736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:14.533791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693768f2-d83e-49ba-81f8-a4a303413736 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:14.551764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 708/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:15.670238 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ecea5-add7-46b7-ab2c-9df61e9c4b2c None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:15.670812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ecea5-add7-46b7-ab2c-9df61e9c4b2c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:15.670812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ecea5-add7-46b7-ab2c-9df61e9c4b2c None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:15.672695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:15.679226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc787fe1-d60f-4284-b7bd-38b5282ab716 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:15.679656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc787fe1-d60f-4284-b7bd-38b5282ab716 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:15.679809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc787fe1-d60f-4284-b7bd-38b5282ab716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:15.754938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-fc787fe1-d60f-4284-b7bd-38b5282ab716 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:15.756144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fc787fe1-d60f-4284-b7bd-38b5282ab716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:15.857899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:16.007679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ecea5-add7-46b7-ab2c-9df61e9c4b2c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:16.009302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-cd4ecea5-add7-46b7-ab2c-9df61e9c4b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:16.093621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:16.155291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ecea5-add7-46b7-ab2c-9df61e9c4b2c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:16.270880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738379a6-9a79-430d-beb8-379774dda36e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:16.271430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738379a6-9a79-430d-beb8-379774dda36e service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:16.271761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738379a6-9a79-430d-beb8-379774dda36e service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:16.272025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738379a6-9a79-430d-beb8-379774dda36e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:16.274485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-738379a6-9a79-430d-beb8-379774dda36e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:16.325391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:16.367586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738379a6-9a79-430d-beb8-379774dda36e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:16.369219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738379a6-9a79-430d-beb8-379774dda36e service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:16.387535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 719/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:17.479444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5a2f4-86d2-47c2-9181-3dc9bc215c92 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:17.480011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5a2f4-86d2-47c2-9181-3dc9bc215c92 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:17.480011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5a2f4-86d2-47c2-9181-3dc9bc215c92 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:17.481301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:19:17.493513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff320c7a-824f-431f-8887-b49e37625ddc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:17.494310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff320c7a-824f-431f-8887-b49e37625ddc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:17.494501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff320c7a-824f-431f-8887-b49e37625ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:17.570305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-ff320c7a-824f-431f-8887-b49e37625ddc None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:17.571528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ff320c7a-824f-431f-8887-b49e37625ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:17.671256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:17.821317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5a2f4-86d2-47c2-9181-3dc9bc215c92 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:17.822808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-cbd5a2f4-86d2-47c2-9181-3dc9bc215c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:17.874499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:17.971508 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5a2f4-86d2-47c2-9181-3dc9bc215c92 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:18.088807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02d9fe-dce1-45da-9d52-9383e53ece69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:18.089359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d9fe-dce1-45da-9d52-9383e53ece69 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:18.089640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d9fe-dce1-45da-9d52-9383e53ece69 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:18.089912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d9fe-dce1-45da-9d52-9383e53ece69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:18.091522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5f02d9fe-dce1-45da-9d52-9383e53ece69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:18.098546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:18.182226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02d9fe-dce1-45da-9d52-9383e53ece69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:18.183854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02d9fe-dce1-45da-9d52-9383e53ece69 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:18.201707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 711/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:19.273189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d120a4-5e72-48b8-a0da-a13877d39685 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:19.273768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d120a4-5e72-48b8-a0da-a13877d39685 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:19.273768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d120a4-5e72-48b8-a0da-a13877d39685 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:19.275167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:19.282760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a28a-ac8b-45b8-8fa0-fd59cf828d16 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:19.283290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a28a-ac8b-45b8-8fa0-fd59cf828d16 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:19.283405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a28a-ac8b-45b8-8fa0-fd59cf828d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:19.364626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-77d4a28a-ac8b-45b8-8fa0-fd59cf828d16 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:19.365891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-77d4a28a-ac8b-45b8-8fa0-fd59cf828d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:19.439061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:19.469679 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:19.626835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d120a4-5e72-48b8-a0da-a13877d39685 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:19.628408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f8d120a4-5e72-48b8-a0da-a13877d39685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:19.646349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:19.774805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d120a4-5e72-48b8-a0da-a13877d39685 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:19.866295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:19.893529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0256b9-19f9-472d-9790-b860e3abd492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:19.894141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0256b9-19f9-472d-9790-b860e3abd492 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:19.894415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0256b9-19f9-472d-9790-b860e3abd492 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:19.894679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0256b9-19f9-472d-9790-b860e3abd492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:19.896274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5a0256b9-19f9-472d-9790-b860e3abd492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:19.982801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0256b9-19f9-472d-9790-b860e3abd492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:19.984433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0256b9-19f9-472d-9790-b860e3abd492 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:20.002500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 722/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:21.048880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee92d9-21f0-4c24-9f81-56484bacaeac None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:21.049431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee92d9-21f0-4c24-9f81-56484bacaeac None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:21.049431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee92d9-21f0-4c24-9f81-56484bacaeac None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:21.051011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:21.058007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1a693-5433-4fb6-9f7f-9875ebadd2a5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:21.058508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1a693-5433-4fb6-9f7f-9875ebadd2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:21.058618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1a693-5433-4fb6-9f7f-9875ebadd2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:21.133843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b3c1a693-5433-4fb6-9f7f-9875ebadd2a5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:21.135060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b3c1a693-5433-4fb6-9f7f-9875ebadd2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:21.177144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:21.233179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:19:21.386321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee92d9-21f0-4c24-9f81-56484bacaeac None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:21.387809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7bee92d9-21f0-4c24-9f81-56484bacaeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:21.534637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee92d9-21f0-4c24-9f81-56484bacaeac None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:21.592876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:21.653438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a99cb9-01ea-472d-a2c7-596c1552c896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:21.653977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99cb9-01ea-472d-a2c7-596c1552c896 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:21.654260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99cb9-01ea-472d-a2c7-596c1552c896 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:21.654537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99cb9-01ea-472d-a2c7-596c1552c896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:21.656188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-70a99cb9-01ea-472d-a2c7-596c1552c896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:21.751199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a99cb9-01ea-472d-a2c7-596c1552c896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:21.752801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a99cb9-01ea-472d-a2c7-596c1552c896 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:21.770793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 714/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:22.852649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08629e0-ef19-47ad-b05d-449d362fa306 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:22.853165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08629e0-ef19-47ad-b05d-449d362fa306 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:22.853165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08629e0-ef19-47ad-b05d-449d362fa306 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:22.854527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:19:22.861633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97265ad-ea67-4bd2-9178-4196e298758c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:22.862100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97265ad-ea67-4bd2-9178-4196e298758c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:22.862209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97265ad-ea67-4bd2-9178-4196e298758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:22.941312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-f97265ad-ea67-4bd2-9178-4196e298758c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:22.942584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f97265ad-ea67-4bd2-9178-4196e298758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:22.944666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:23.039839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:23.192004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08629e0-ef19-47ad-b05d-449d362fa306 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:23.193589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d08629e0-ef19-47ad-b05d-449d362fa306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:23.339804 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08629e0-ef19-47ad-b05d-449d362fa306 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:23.367964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:23.453536 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f695c2-8eeb-400d-8848-a6b641517f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:23.454059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f695c2-8eeb-400d-8848-a6b641517f49 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:23.454339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f695c2-8eeb-400d-8848-a6b641517f49 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:23.454611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f695c2-8eeb-400d-8848-a6b641517f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:23.456254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e7f695c2-8eeb-400d-8848-a6b641517f49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:23.546547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f695c2-8eeb-400d-8848-a6b641517f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:23.548198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f695c2-8eeb-400d-8848-a6b641517f49 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:23.566916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 725/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:25.681221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa40f7-50d3-40d2-b4b2-86d62088d639 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:25.681668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa40f7-50d3-40d2-b4b2-86d62088d639 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:25.681801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa40f7-50d3-40d2-b4b2-86d62088d639 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:25.683160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:25.689262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c9d6-5119-496d-a500-32e0a8816f0c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:25.689703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c9d6-5119-496d-a500-32e0a8816f0c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:25.689837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c9d6-5119-496d-a500-32e0a8816f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:25.730383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:25.757126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-a3f8c9d6-5119-496d-a500-32e0a8816f0c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:25.758361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a3f8c9d6-5119-496d-a500-32e0a8816f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:25.855086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:26.147042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa40f7-50d3-40d2-b4b2-86d62088d639 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:26.148625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2baa40f7-50d3-40d2-b4b2-86d62088d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:26.252284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa40f7-50d3-40d2-b4b2-86d62088d639 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:26.285437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:26.328825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb863ab-e3c1-4c34-aa18-1808407191c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:26.329479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb863ab-e3c1-4c34-aa18-1808407191c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:26.329761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb863ab-e3c1-4c34-aa18-1808407191c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:26.330035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb863ab-e3c1-4c34-aa18-1808407191c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:26.331678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-adb863ab-e3c1-4c34-aa18-1808407191c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:26.441680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb863ab-e3c1-4c34-aa18-1808407191c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:26.443126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb863ab-e3c1-4c34-aa18-1808407191c4 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:26.461828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 717/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:28.784635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f60b0-12ae-4215-a35f-1256714c24d2 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:28.785143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f60b0-12ae-4215-a35f-1256714c24d2 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:28.785143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f60b0-12ae-4215-a35f-1256714c24d2 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:28.786496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:28.791996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d292bc-2d7c-4e09-aa8a-8a4e2ce2088c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:28.792428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d292bc-2d7c-4e09-aa8a-8a4e2ce2088c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:28.792534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d292bc-2d7c-4e09-aa8a-8a4e2ce2088c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:28.859390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-18d292bc-2d7c-4e09-aa8a-8a4e2ce2088c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:28.860623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-18d292bc-2d7c-4e09-aa8a-8a4e2ce2088c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:28.873789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:28.959995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:29.239998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f60b0-12ae-4215-a35f-1256714c24d2 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:29.241618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7d2f60b0-12ae-4215-a35f-1256714c24d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:29.346631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f60b0-12ae-4215-a35f-1256714c24d2 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:29.360022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:29.425729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccb36d-397a-48fa-9547-4e4bea6e946d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:29.426378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb36d-397a-48fa-9547-4e4bea6e946d service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:29.426664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb36d-397a-48fa-9547-4e4bea6e946d service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:29.426942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb36d-397a-48fa-9547-4e4bea6e946d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:29.428650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2bccb36d-397a-48fa-9547-4e4bea6e946d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:29.539769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccb36d-397a-48fa-9547-4e4bea6e946d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:29.541211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccb36d-397a-48fa-9547-4e4bea6e946d service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:29.561314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 728/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:32.070118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cec190-64d5-40b1-9c65-d9dd68ae2d8d None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:32.070651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cec190-64d5-40b1-9c65-d9dd68ae2d8d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:32.070651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cec190-64d5-40b1-9c65-d9dd68ae2d8d None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:32.071939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:32.077432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf4e61-61e2-43a7-b899-360df3c58a75 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:32.077833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf4e61-61e2-43a7-b899-360df3c58a75 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:32.078000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf4e61-61e2-43a7-b899-360df3c58a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:32.127292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:32.146167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6ddf4e61-61e2-43a7-b899-360df3c58a75 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:32.147390 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6ddf4e61-61e2-43a7-b899-360df3c58a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:32.244350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:32.551317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cec190-64d5-40b1-9c65-d9dd68ae2d8d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:32.552908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-75cec190-64d5-40b1-9c65-d9dd68ae2d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:32.664713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cec190-64d5-40b1-9c65-d9dd68ae2d8d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:32.714942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:32.751340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed14b5-a53b-437e-a6f5-a92c487c899b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:32.751968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed14b5-a53b-437e-a6f5-a92c487c899b service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:32.752261 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed14b5-a53b-437e-a6f5-a92c487c899b service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:32.752547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed14b5-a53b-437e-a6f5-a92c487c899b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:32.754280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d3ed14b5-a53b-437e-a6f5-a92c487c899b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:32.868213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed14b5-a53b-437e-a6f5-a92c487c899b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:32.869736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed14b5-a53b-437e-a6f5-a92c487c899b service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:32.889025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 720/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:35.254331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8b670-e009-4a59-a6db-26ff44d574f8 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:35.254908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8b670-e009-4a59-a6db-26ff44d574f8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:35.254908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8b670-e009-4a59-a6db-26ff44d574f8 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:35.256252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:35.261701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004b4f-d9a5-4cbe-b523-71608b499d88 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:35.262178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004b4f-d9a5-4cbe-b523-71608b499d88 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:35.262288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004b4f-d9a5-4cbe-b523-71608b499d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:35.330433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-68004b4f-d9a5-4cbe-b523-71608b499d88 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:35.331664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-68004b4f-d9a5-4cbe-b523-71608b499d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:35.353021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:35.430717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:35.714085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8b670-e009-4a59-a6db-26ff44d574f8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:35.715658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-37b8b670-e009-4a59-a6db-26ff44d574f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:35.820422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8b670-e009-4a59-a6db-26ff44d574f8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:35.842215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:35.896855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfc4f8-a3ea-49dc-9ffd-213a813f9bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:35.897502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfc4f8-a3ea-49dc-9ffd-213a813f9bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:35.897795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfc4f8-a3ea-49dc-9ffd-213a813f9bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:35.898070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfc4f8-a3ea-49dc-9ffd-213a813f9bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:35.899677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5edfc4f8-a3ea-49dc-9ffd-213a813f9bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:36.012901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfc4f8-a3ea-49dc-9ffd-213a813f9bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:36.015008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfc4f8-a3ea-49dc-9ffd-213a813f9bf7 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:36.036954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 731/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:38.543989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11002c-9a56-4a1b-a4bd-6d9910f29c46 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:38.544548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11002c-9a56-4a1b-a4bd-6d9910f29c46 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:38.544657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11002c-9a56-4a1b-a4bd-6d9910f29c46 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:38.545953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:38.551306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9cab5-8149-4981-93b2-2e39b82a9cbd None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:38.551692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9cab5-8149-4981-93b2-2e39b82a9cbd None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:38.551875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9cab5-8149-4981-93b2-2e39b82a9cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:38.616892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:38.619828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-97c9cab5-8149-4981-93b2-2e39b82a9cbd None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:38.621661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-97c9cab5-8149-4981-93b2-2e39b82a9cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:38.718227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:19:38.998390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11002c-9a56-4a1b-a4bd-6d9910f29c46 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:38.999971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8d11002c-9a56-4a1b-a4bd-6d9910f29c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:39.103876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11002c-9a56-4a1b-a4bd-6d9910f29c46 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:39.152979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:39.178027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08883c21-e5b7-4a44-beec-8c4bd1b62b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:39.178637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08883c21-e5b7-4a44-beec-8c4bd1b62b07 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:39.178917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08883c21-e5b7-4a44-beec-8c4bd1b62b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:39.179187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08883c21-e5b7-4a44-beec-8c4bd1b62b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:39.180789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-08883c21-e5b7-4a44-beec-8c4bd1b62b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:39.295575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08883c21-e5b7-4a44-beec-8c4bd1b62b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:39.297057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08883c21-e5b7-4a44-beec-8c4bd1b62b07 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:39.324817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 723/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:41.516512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031029-0a1e-4a02-9473-d1fc99c74550 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:41.517018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031029-0a1e-4a02-9473-d1fc99c74550 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:41.517137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031029-0a1e-4a02-9473-d1fc99c74550 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:41.518435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:19:41.523832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ab82-7d3d-470d-af6d-cbe977bd8990 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:41.524290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ab82-7d3d-470d-af6d-cbe977bd8990 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:41.524398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ab82-7d3d-470d-af6d-cbe977bd8990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:41.592390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ab57ab82-7d3d-470d-af6d-cbe977bd8990 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:41.593667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ab57ab82-7d3d-470d-af6d-cbe977bd8990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:41.624588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:41.695282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:41.982420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031029-0a1e-4a02-9473-d1fc99c74550 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:41.984107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-27031029-0a1e-4a02-9473-d1fc99c74550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:42.093726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031029-0a1e-4a02-9473-d1fc99c74550 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:42.123394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:42.168182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe51276-675b-4c4d-bd15-5e407e40e78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:42.168788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51276-675b-4c4d-bd15-5e407e40e78c service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:42.169066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51276-675b-4c4d-bd15-5e407e40e78c service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:42.169870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51276-675b-4c4d-bd15-5e407e40e78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:42.171542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7fe51276-675b-4c4d-bd15-5e407e40e78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:42.284224 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe51276-675b-4c4d-bd15-5e407e40e78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:42.285587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe51276-675b-4c4d-bd15-5e407e40e78c service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:42.304865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 734/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:44.655299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaf5a9-0f1f-4e4a-a0ac-fe5fa349339f None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:44.655895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaf5a9-0f1f-4e4a-a0ac-fe5fa349339f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:44.655895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaf5a9-0f1f-4e4a-a0ac-fe5fa349339f None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:44.658248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:44.662706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f75e4-4e2a-4dd2-be12-8d7e0f965d97 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:44.663154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f75e4-4e2a-4dd2-be12-8d7e0f965d97 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:44.663282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f75e4-4e2a-4dd2-be12-8d7e0f965d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:44.730096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b17f75e4-4e2a-4dd2-be12-8d7e0f965d97 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:44.731215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b17f75e4-4e2a-4dd2-be12-8d7e0f965d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:44.739895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:44.834065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:45.121659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaf5a9-0f1f-4e4a-a0ac-fe5fa349339f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:45.123912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-19eaf5a9-0f1f-4e4a-a0ac-fe5fa349339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:45.229425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaf5a9-0f1f-4e4a-a0ac-fe5fa349339f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:45.287479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:45.308483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb186b-d129-4725-a494-067bd9235467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:45.309103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb186b-d129-4725-a494-067bd9235467 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:45.309433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb186b-d129-4725-a494-067bd9235467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:45.309712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb186b-d129-4725-a494-067bd9235467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:45.311390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-59cb186b-d129-4725-a494-067bd9235467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:45.434174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb186b-d129-4725-a494-067bd9235467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:45.435920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb186b-d129-4725-a494-067bd9235467 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:45.458598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 726/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:47.734947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544c8f-541a-4b14-8259-85d6f63ff33d None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:47.735513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544c8f-541a-4b14-8259-85d6f63ff33d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:47.735513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2544c8f-541a-4b14-8259-85d6f63ff33d None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:47.736891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:47.742775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d8b8-8325-46c4-a3b8-df8e99e18edb None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:47.743180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d8b8-8325-46c4-a3b8-df8e99e18edb None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:47.743342 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d8b8-8325-46c4-a3b8-df8e99e18edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:47.815858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2b03d8b8-8325-46c4-a3b8-df8e99e18edb None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:47.817081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2b03d8b8-8325-46c4-a3b8-df8e99e18edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:47.855337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:47.914040 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:48.209610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2544c8f-541a-4b14-8259-85d6f63ff33d None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:48.211229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d2544c8f-541a-4b14-8259-85d6f63ff33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:48.317584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2544c8f-541a-4b14-8259-85d6f63ff33d None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:48.355904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:48.392884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5ea9c-04d2-4060-94ae-893751c736d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:48.393385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5ea9c-04d2-4060-94ae-893751c736d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:48.393671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5ea9c-04d2-4060-94ae-893751c736d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:48.393948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5ea9c-04d2-4060-94ae-893751c736d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:48.395557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-58c5ea9c-04d2-4060-94ae-893751c736d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:48.508278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5ea9c-04d2-4060-94ae-893751c736d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:48.509750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5ea9c-04d2-4060-94ae-893751c736d6 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:48.528422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 737/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:50.694973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca1c38-09fe-4089-a318-905cd444fdb2 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:50.695451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca1c38-09fe-4089-a318-905cd444fdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:50.695451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca1c38-09fe-4089-a318-905cd444fdb2 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:50.696786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:50.702182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bae78-d1a5-4037-a8ca-5397e731a292 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:50.702627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bae78-d1a5-4037-a8ca-5397e731a292 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:50.702740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bae78-d1a5-4037-a8ca-5397e731a292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:50.767605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f50bae78-d1a5-4037-a8ca-5397e731a292 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:50.768817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f50bae78-d1a5-4037-a8ca-5397e731a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:50.786825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:50.865255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:51.153822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca1c38-09fe-4089-a318-905cd444fdb2 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:51.155432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-52ca1c38-09fe-4089-a318-905cd444fdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:51.263500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca1c38-09fe-4089-a318-905cd444fdb2 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:51.449074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:51.457671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89213906-aaba-4819-abcb-e56982cb1ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:51.458316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89213906-aaba-4819-abcb-e56982cb1ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:51.458573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89213906-aaba-4819-abcb-e56982cb1ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:51.458848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89213906-aaba-4819-abcb-e56982cb1ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:51.460470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-89213906-aaba-4819-abcb-e56982cb1ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:51.571835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89213906-aaba-4819-abcb-e56982cb1ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:51.573280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89213906-aaba-4819-abcb-e56982cb1ce0 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:51.591710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 729/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:19:53.797006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678becd-a775-4c5e-b8fc-e291b1273223 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:53.797588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678becd-a775-4c5e-b8fc-e291b1273223 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:53.797588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678becd-a775-4c5e-b8fc-e291b1273223 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:53.798961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:19:53.804398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba4f1-9bc6-4f37-bbb9-a0b8b7901ca8 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:53.804857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba4f1-9bc6-4f37-bbb9-a0b8b7901ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:53.804969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba4f1-9bc6-4f37-bbb9-a0b8b7901ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:53.871106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-564ba4f1-9bc6-4f37-bbb9-a0b8b7901ca8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:19:53.872827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-564ba4f1-9bc6-4f37-bbb9-a0b8b7901ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:53.926040 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:53.974119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:19:54.257631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678becd-a775-4c5e-b8fc-e291b1273223 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:19:54.259222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f678becd-a775-4c5e-b8fc-e291b1273223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:54.366336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678becd-a775-4c5e-b8fc-e291b1273223 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:19:54.417578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:19:54.445747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4675bd3-af96-4f61-9577-9cab84903daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:19:54.446374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4675bd3-af96-4f61-9577-9cab84903daa service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:19:54.447186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4675bd3-af96-4f61-9577-9cab84903daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:19:54.447186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4675bd3-af96-4f61-9577-9cab84903daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:19:54.448556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d4675bd3-af96-4f61-9577-9cab84903daa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:19:54.562473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4675bd3-af96-4f61-9577-9cab84903daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:19:54.563847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4675bd3-af96-4f61-9577-9cab84903daa service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:19:54.584640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 740/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:20:03.972709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=22 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:04.581728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=66 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:15.012388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d6959-6513-47e1-a8c1-b040223d1be0 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:15.013012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d6959-6513-47e1-a8c1-b040223d1be0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:15.013012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d6959-6513-47e1-a8c1-b040223d1be0 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:15.014301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 731/1471] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:20:15.020625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fdb0c-b6b9-452a-bdf0-40a72c581c3b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:15.021138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fdb0c-b6b9-452a-bdf0-40a72c581c3b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:15.021641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fdb0c-b6b9-452a-bdf0-40a72c581c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:15.221570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-e12fdb0c-b6b9-452a-bdf0-40a72c581c3b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:20:15.222883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e12fdb0c-b6b9-452a-bdf0-40a72c581c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:15.331763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 741/1472] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:20:15.634416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e7d92-ec7b-40bc-9d8d-48035477f371 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:15.634705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e7d92-ec7b-40bc-9d8d-48035477f371 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:15.634983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e7d92-ec7b-40bc-9d8d-48035477f371 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:15.636846 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 732/1473] 10.222.0.61 () {54 vars in 962 bytes} [Thu Sep 22 18:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:20:15.642013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff14a17-5831-4cea-aea4-486b3c2e92d0 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:15.642308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff14a17-5831-4cea-aea4-486b3c2e92d0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:15.642585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff14a17-5831-4cea-aea4-486b3c2e92d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:15.722456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-aff14a17-5831-4cea-aea4-486b3c2e92d0 None None] MFA Rules not processed for user `2ab45d09f8724d9ca5b6fb1fa050fdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:20:15.723698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-aff14a17-5831-4cea-aea4-486b3c2e92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:15.744891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:15.802404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 742/1474] 10.222.0.61 () {58 vars in 1059 bytes} [Thu Sep 22 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:20:15.810154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e7d92-ec7b-40bc-9d8d-48035477f371 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:20:15.811697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8c4e7d92-ec7b-40bc-9d8d-48035477f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:15.920605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e7d92-ec7b-40bc-9d8d-48035477f371 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:20:15.997460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073840e-84b1-4981-80fb-4463fb5e74fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab45d09f8724d9ca5b6fb1fa050fdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:20:15.998075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073840e-84b1-4981-80fb-4463fb5e74fc service glance] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:15.998353 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073840e-84b1-4981-80fb-4463fb5e74fc service glance] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:15.998642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073840e-84b1-4981-80fb-4463fb5e74fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:16.000275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b073840e-84b1-4981-80fb-4463fb5e74fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:16.055933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:16.113180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073840e-84b1-4981-80fb-4463fb5e74fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:20:16.114655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073840e-84b1-4981-80fb-4463fb5e74fc service glance] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:20:16.133493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 733/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:20:18.407018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1cca4-39a9-4d24-a809-631b5472d42b None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:18.407564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1cca4-39a9-4d24-a809-631b5472d42b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:18.407564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1cca4-39a9-4d24-a809-631b5472d42b None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:18.409106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 743/1476] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:20:18.414825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22547ad9-a906-466e-81d9-46c8f3a140c9 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:18.415280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22547ad9-a906-466e-81d9-46c8f3a140c9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:18.415381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22547ad9-a906-466e-81d9-46c8f3a140c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:18.484485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-22547ad9-a906-466e-81d9-46c8f3a140c9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:20:18.486419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-22547ad9-a906-466e-81d9-46c8f3a140c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:18.596619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 734/1477] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:20:18.876968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1cca4-39a9-4d24-a809-631b5472d42b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:20:18.878755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e4a1cca4-39a9-4d24-a809-631b5472d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:19.016253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1cca4-39a9-4d24-a809-631b5472d42b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:20:19.073734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:19.122387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbec3f-c63a-4eb8-b4f6-6a547ecdee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:20:19.124920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbec3f-c63a-4eb8-b4f6-6a547ecdee84 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:19.125215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbec3f-c63a-4eb8-b4f6-6a547ecdee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:19.125520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbec3f-c63a-4eb8-b4f6-6a547ecdee84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:19.126176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbec3f-c63a-4eb8-b4f6-6a547ecdee84 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:20:19.127951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING py.warnings [None req-57cbec3f-c63a-4eb8-b4f6-6a547ecdee84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:20:19.127951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: warnings.warn(msg) Sep 22 18:20:19.127951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: Sep 22 18:20:19.131436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbec3f-c63a-4eb8-b4f6-6a547ecdee84 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:20:19.151937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 744/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Thu Sep 22 18:20:18 2022] GET /identity/v3/projects => generated 2553 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:20:21.392305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7615f-1323-4e6a-9b6e-66abbd6a6049 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:21.392886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7615f-1323-4e6a-9b6e-66abbd6a6049 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:21.393019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7615f-1323-4e6a-9b6e-66abbd6a6049 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:21.394441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 735/1479] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:20:21.400060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb004d5-b0ae-49c6-8275-1fbb88824a6c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:21.400541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb004d5-b0ae-49c6-8275-1fbb88824a6c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:21.400644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb004d5-b0ae-49c6-8275-1fbb88824a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:21.470915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-abb004d5-b0ae-49c6-8275-1fbb88824a6c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:20:21.472165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-abb004d5-b0ae-49c6-8275-1fbb88824a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:21.581182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 745/1480] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:20:21.878454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7615f-1323-4e6a-9b6e-66abbd6a6049 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:20:21.880185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-91b7615f-1323-4e6a-9b6e-66abbd6a6049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:21.891293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:22.032240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7615f-1323-4e6a-9b6e-66abbd6a6049 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:20:22.113257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:22.146661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e4e9a-4857-47ad-9fa9-b535b3d5c386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:20:22.147277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e4e9a-4857-47ad-9fa9-b535b3d5c386 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:22.147560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e4e9a-4857-47ad-9fa9-b535b3d5c386 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:22.147837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e4e9a-4857-47ad-9fa9-b535b3d5c386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:22.149502 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-588e4e9a-4857-47ad-9fa9-b535b3d5c386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:22.240415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e4e9a-4857-47ad-9fa9-b535b3d5c386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:20:22.242060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e4e9a-4857-47ad-9fa9-b535b3d5c386 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:20:22.261741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 736/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:20:24.682208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5b46-f22f-44f3-a6a8-e06f65355d7a None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:24.683311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5b46-f22f-44f3-a6a8-e06f65355d7a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:24.683311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5b46-f22f-44f3-a6a8-e06f65355d7a None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:24.684688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 746/1482] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:20:24.690190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0265d8-63d2-45e6-8a2c-d57abb5f61f6 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:24.690635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0265d8-63d2-45e6-8a2c-d57abb5f61f6 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:24.690800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0265d8-63d2-45e6-8a2c-d57abb5f61f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:24.760751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6a0265d8-63d2-45e6-8a2c-d57abb5f61f6 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:20:24.761915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6a0265d8-63d2-45e6-8a2c-d57abb5f61f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:24.812186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:24.864923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 737/1483] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:20:25.156139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5b46-f22f-44f3-a6a8-e06f65355d7a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:20:25.157715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-71dc5b46-f22f-44f3-a6a8-e06f65355d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:25.184756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:25.315752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5b46-f22f-44f3-a6a8-e06f65355d7a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:20:25.396575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f87f1e-6b89-499b-90d6-3c9287222115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:20:25.397100 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f87f1e-6b89-499b-90d6-3c9287222115 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:25.397424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f87f1e-6b89-499b-90d6-3c9287222115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:25.397700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f87f1e-6b89-499b-90d6-3c9287222115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:25.399322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-20f87f1e-6b89-499b-90d6-3c9287222115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:25.516027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:25.553790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f87f1e-6b89-499b-90d6-3c9287222115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:20:25.555269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f87f1e-6b89-499b-90d6-3c9287222115 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:20:25.575829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 747/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:20:27.881977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f130ed-7dd6-41cf-8fbc-bdf20ecb0a52 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:27.882522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f130ed-7dd6-41cf-8fbc-bdf20ecb0a52 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:27.882619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f130ed-7dd6-41cf-8fbc-bdf20ecb0a52 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:27.883943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 738/1485] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:20:27.889930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faf247-5f61-4067-8880-bb1a7459ae66 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:27.890373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faf247-5f61-4067-8880-bb1a7459ae66 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:27.890466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faf247-5f61-4067-8880-bb1a7459ae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:27.956565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-40faf247-5f61-4067-8880-bb1a7459ae66 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:20:27.957732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-40faf247-5f61-4067-8880-bb1a7459ae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:28.055315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 748/1486] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:20:28.346087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f130ed-7dd6-41cf-8fbc-bdf20ecb0a52 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:20:28.347636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a7f130ed-7dd6-41cf-8fbc-bdf20ecb0a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:28.458614 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f130ed-7dd6-41cf-8fbc-bdf20ecb0a52 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:20:28.541049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:28.543722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ad5a4-e3ff-4b84-af3a-7a84b0276f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:20:28.544426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ad5a4-e3ff-4b84-af3a-7a84b0276f3e service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:28.544905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ad5a4-e3ff-4b84-af3a-7a84b0276f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:28.545409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ad5a4-e3ff-4b84-af3a-7a84b0276f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:28.547520 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-339ad5a4-e3ff-4b84-af3a-7a84b0276f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:28.673180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ad5a4-e3ff-4b84-af3a-7a84b0276f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:20:28.673180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ad5a4-e3ff-4b84-af3a-7a84b0276f3e service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:20:28.692165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 739/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:20:30.940501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf6068-240c-4dcf-89c8-6bf232025afa None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:30.941075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf6068-240c-4dcf-89c8-6bf232025afa None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:30.941075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf6068-240c-4dcf-89c8-6bf232025afa None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:30.942399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 749/1488] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:20:30.948227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820635-9f2c-4199-9e36-487cbee0594b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:30.948691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820635-9f2c-4199-9e36-487cbee0594b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:30.948800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820635-9f2c-4199-9e36-487cbee0594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:31.015427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-f8820635-9f2c-4199-9e36-487cbee0594b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:20:31.016648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f8820635-9f2c-4199-9e36-487cbee0594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:31.069226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:31.112776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 740/1489] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:20:31.403947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf6068-240c-4dcf-89c8-6bf232025afa None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:20:31.405535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2fdf6068-240c-4dcf-89c8-6bf232025afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:31.441735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:31.510205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf6068-240c-4dcf-89c8-6bf232025afa None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:20:31.583870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1215b-b813-426b-a53b-3d4dc4c0ed35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:20:31.584491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1215b-b813-426b-a53b-3d4dc4c0ed35 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:31.584774 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1215b-b813-426b-a53b-3d4dc4c0ed35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:31.585052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1215b-b813-426b-a53b-3d4dc4c0ed35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:31.586702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-67c1215b-b813-426b-a53b-3d4dc4c0ed35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:31.676848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:31.715602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1215b-b813-426b-a53b-3d4dc4c0ed35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:20:31.717362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1215b-b813-426b-a53b-3d4dc4c0ed35 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:20:31.738089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 750/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:20:34.148279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2209-b158-48a0-ac62-b377fb385cb9 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:34.148798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2209-b158-48a0-ac62-b377fb385cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:34.148798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2209-b158-48a0-ac62-b377fb385cb9 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:34.150111 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 741/1491] 10.222.0.61 () {54 vars in 927 bytes} [Thu Sep 22 18:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:20:34.156047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d671-f2c3-4fd5-a8c0-34a2aa20bc66 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:34.156461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d671-f2c3-4fd5-a8c0-34a2aa20bc66 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:34.156602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d671-f2c3-4fd5-a8c0-34a2aa20bc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:34.223597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4333d671-f2c3-4fd5-a8c0-34a2aa20bc66 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:20:34.225079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4333d671-f2c3-4fd5-a8c0-34a2aa20bc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:34.326541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 751/1492] 10.222.0.61 () {58 vars in 1024 bytes} [Thu Sep 22 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:20:34.632496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2209-b158-48a0-ac62-b377fb385cb9 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:20:34.636079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f8da2209-b158-48a0-ac62-b377fb385cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:34.754231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2209-b158-48a0-ac62-b377fb385cb9 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:20:34.827473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80230822-58a8-412e-8c87-2779b3cf930b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:20:34.828085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80230822-58a8-412e-8c87-2779b3cf930b service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:20:34.828394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80230822-58a8-412e-8c87-2779b3cf930b service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:20:34.828685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80230822-58a8-412e-8c87-2779b3cf930b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:20:34.830346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-80230822-58a8-412e-8c87-2779b3cf930b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:20:34.839274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:34.940442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80230822-58a8-412e-8c87-2779b3cf930b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:20:34.941936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80230822-58a8-412e-8c87-2779b3cf930b service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:20:34.966292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 742/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:20:44.325176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=82 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:20:44.963640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=50 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:48.135347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de963c6-c513-44c3-bb7e-062d9ec488b8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:48.135915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de963c6-c513-44c3-bb7e-062d9ec488b8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:48.135915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de963c6-c513-44c3-bb7e-062d9ec488b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:48.221046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4de963c6-c513-44c3-bb7e-062d9ec488b8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:21:48.223168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4de963c6-c513-44c3-bb7e-062d9ec488b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:48.333897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 752/1494] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:21:48.341998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fe62c-51bf-4daf-92f8-3bc5920a0559 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:48.342587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fe62c-51bf-4daf-92f8-3bc5920a0559 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:48.342587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fe62c-51bf-4daf-92f8-3bc5920a0559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:48.417954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ad5fe62c-51bf-4daf-92f8-3bc5920a0559 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:21:48.419099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ad5fe62c-51bf-4daf-92f8-3bc5920a0559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:48.517948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 743/1495] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:21:48.522874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de963c6-c513-44c3-bb7e-062d9ec488b8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:48.524560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4de963c6-c513-44c3-bb7e-062d9ec488b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:48.536150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de963c6-c513-44c3-bb7e-062d9ec488b8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:48.601060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:48.637350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:48.637961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:48.638241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:48.638515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:48.639165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:21:48.639467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:48.641381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING py.warnings [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:21:48.641381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: warnings.warn(msg) Sep 22 18:21:48.641381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: Sep 22 18:21:48.642322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:48.655101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 753/1496] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:21:48.664415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fe62c-51bf-4daf-92f8-3bc5920a0559 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:48.677830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fe62c-51bf-4daf-92f8-3bc5920a0559 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:48.745036 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:48.781753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:48.782368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:48.782652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:48.782925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:48.783562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:48.785309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: WARNING py.warnings [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:21:48.785309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: warnings.warn(msg) Sep 22 18:21:48.785309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: Sep 22 18:21:48.786492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:48.844984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 744/1497] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:21:48 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:21:48.849435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:48.851505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:48.885451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d6f42-157f-4a8c-9032-948ebcbe4e6d admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:48.978405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:48.978917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:48.979195 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:48.979464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:48.980129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:48.981131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING py.warnings [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:21:48.981131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: warnings.warn(msg) Sep 22 18:21:48.981131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: Sep 22 18:21:48.982357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:49.025853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 754/1498] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:21:48 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:21:49.030090 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:49.031648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:49.093700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e245e-3634-4f87-98b3-b6dbb1d69a47 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:49.175934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:49.187282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:49.187892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:49.188168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:49.188434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:49.189065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:49.190097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: WARNING py.warnings [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:21:49.190097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: warnings.warn(msg) Sep 22 18:21:49.190097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: Sep 22 18:21:49.191101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:49.203993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 745/1499] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:21:49.208082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:49.209706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:49.220975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2492b-db05-4b43-aa57-09a6f97625d4 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:49.250607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:49.325975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb1502-d00d-4209-8a9f-3fa41185595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:49.326589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb1502-d00d-4209-8a9f-3fa41185595b admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:49.326866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb1502-d00d-4209-8a9f-3fa41185595b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:49.327139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb1502-d00d-4209-8a9f-3fa41185595b admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:49.327771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb1502-d00d-4209-8a9f-3fa41185595b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:49.328772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING py.warnings [None req-d1cb1502-d00d-4209-8a9f-3fa41185595b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:21:49.328772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: warnings.warn(msg) Sep 22 18:21:49.328772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: Sep 22 18:21:49.329680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb1502-d00d-4209-8a9f-3fa41185595b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:49.341927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 755/1500] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:21:49.346148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:49.347685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:49.381115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965b4c3-a1a2-4b65-9faf-d02393d252fa admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:49.478365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094aea-21de-4a36-bcc3-292d636e39b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:49.479038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094aea-21de-4a36-bcc3-292d636e39b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:49.479316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094aea-21de-4a36-bcc3-292d636e39b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:49.479588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094aea-21de-4a36-bcc3-292d636e39b2 admin admin] PATH_INFO: `/v3/projects/c68366c6e0094baf83abe9bb9f1b28d9/users/a879a405e7f24ea2a245a65ffdfca32e/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:49.502234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094aea-21de-4a36-bcc3-292d636e39b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68366c6e0094baf83abe9bb9f1b28d9, user_id=a879a405e7f24ea2a245a65ffdfca32e, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:49.503248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: WARNING py.warnings [None req-ad094aea-21de-4a36-bcc3-292d636e39b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:21:49.503248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: warnings.warn(msg) Sep 22 18:21:49.503248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: Sep 22 18:21:49.505299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094aea-21de-4a36-bcc3-292d636e39b2 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:49.531593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 746/1501] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:21:49 2022] PUT /identity/v3/projects/c68366c6e0094baf83abe9bb9f1b28d9/users/a879a405e7f24ea2a245a65ffdfca32e/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:21:49.543616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b1217-6727-488d-91d0-52d22fe7149f None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:49.543998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b1217-6727-488d-91d0-52d22fe7149f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:49.544285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b1217-6727-488d-91d0-52d22fe7149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:49.604167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-308b1217-6727-488d-91d0-52d22fe7149f None None] MFA Rules not processed for user `a879a405e7f24ea2a245a65ffdfca32e`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:21:49.605435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-308b1217-6727-488d-91d0-52d22fe7149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:49.688540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 756/1502] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:21:49.702481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8c20-783c-4397-a920-192d1260d0f7 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:49.702771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8c20-783c-4397-a920-192d1260d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:49.703050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8c20-783c-4397-a920-192d1260d0f7 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:49.704395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 747/1503] 10.222.0.61 () {54 vars in 963 bytes} [Thu Sep 22 18:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:21:49.710506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b590056-3075-43b9-897e-42ad9d600cd1 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:49.710810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b590056-3075-43b9-897e-42ad9d600cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:49.711089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b590056-3075-43b9-897e-42ad9d600cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:49.742620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:49.790526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3b590056-3075-43b9-897e-42ad9d600cd1 None None] MFA Rules not processed for user `465cff05c2ed4fe19e99289379c2966d`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:21:49.791655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3b590056-3075-43b9-897e-42ad9d600cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:49.867246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 757/1504] 10.222.0.61 () {58 vars in 1060 bytes} [Thu Sep 22 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:21:49.876934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c8c20-783c-4397-a920-192d1260d0f7 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:49.878508 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-432c8c20-783c-4397-a920-192d1260d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:49.933786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:49.988025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c8c20-783c-4397-a920-192d1260d0f7 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:50.062437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:50.062972 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:50.063253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:50.063524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:50.065126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:50.162423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:50.164379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:50.167894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:50.183448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 748/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:21:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:21:50.230866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29632150-cdfb-4ec5-9eb7-95a446f0c4d9 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:50.231313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29632150-cdfb-4ec5-9eb7-95a446f0c4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:50.231422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29632150-cdfb-4ec5-9eb7-95a446f0c4d9 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:50.232696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 758/1506] 10.222.0.61 () {52 vars in 830 bytes} [Thu Sep 22 18:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:21:50.236748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:50.238081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:50.342138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3aaff3-20a3-4124-84c7-61dad9fb5450 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:50.436544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:50.437181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:50.437471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:50.437800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] PATH_INFO: `/v3/users/a879a405e7f24ea2a245a65ffdfca32e` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:50.450567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a879a405e7f24ea2a245a65ffdfca32e)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:50.451593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: WARNING py.warnings [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:21:50.451593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: warnings.warn(msg) Sep 22 18:21:50.451593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: Sep 22 18:21:50.452806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:50.462463 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:50.520307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a879a405e7f24ea2a245a65ffdfca32e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:50.531013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a879a405e7f24ea2a245a65ffdfca32e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:50.531526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a879a405e7f24ea2a245a65ffdfca32e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:50.556462 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a879a405e7f24ea2a245a65ffdfca32e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:50.570248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a879a405e7f24ea2a245a65ffdfca32e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:50.575929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 749/1507] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:21:50 2022] DELETE /identity/v3/users/a879a405e7f24ea2a245a65ffdfca32e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:21:50.580407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb80b43-d5f8-4d73-ab34-7f1198e728bc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:50.580699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb80b43-d5f8-4d73-ab34-7f1198e728bc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:50.580983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb80b43-d5f8-4d73-ab34-7f1198e728bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:50.638218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1eb80b43-d5f8-4d73-ab34-7f1198e728bc None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:21:50.639330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1eb80b43-d5f8-4d73-ab34-7f1198e728bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:50.716313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:50.730118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 759/1508] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:21:50.740516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:50.741866 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:50.841841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cfdba-a3f6-406a-9a96-68f19c12e924 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:50.896612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:21:50.921913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f43231-fd59-42e8-a6df-35bc2ba632b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:50.922542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f43231-fd59-42e8-a6df-35bc2ba632b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:50.922827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f43231-fd59-42e8-a6df-35bc2ba632b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:50.923101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f43231-fd59-42e8-a6df-35bc2ba632b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:50.924820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-59f43231-fd59-42e8-a6df-35bc2ba632b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:51.034780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f43231-fd59-42e8-a6df-35bc2ba632b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:51.036210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f43231-fd59-42e8-a6df-35bc2ba632b2 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:51.054303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 750/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:21:51.418573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb80b43-d5f8-4d73-ab34-7f1198e728bc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:21:51.419868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1eb80b43-d5f8-4d73-ab34-7f1198e728bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:21:51.431869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb80b43-d5f8-4d73-ab34-7f1198e728bc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:21:51.532545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:21:51.533181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:21:51.533489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:21:51.533763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] PATH_INFO: `/v3/projects/c68366c6e0094baf83abe9bb9f1b28d9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:21:51.543629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68366c6e0094baf83abe9bb9f1b28d9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:21:51.544654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING py.warnings [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:21:51.544654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: warnings.warn(msg) Sep 22 18:21:51.544654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: Sep 22 18:21:51.545903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:21:51.613284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68366c6e0094baf83abe9bb9f1b28d9', 'request_id': 'req-e0fae8dc-ada5-4543-bbdd-134d118a7976'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:51.623137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68366c6e0094baf83abe9bb9f1b28d9', 'request_id': 'req-e0fae8dc-ada5-4543-bbdd-134d118a7976'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:51.629417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68366c6e0094baf83abe9bb9f1b28d9', 'request_id': 'req-e0fae8dc-ada5-4543-bbdd-134d118a7976'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:51.667772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] The token cache is being invalidate because project c68366c6e0094baf83abe9bb9f1b28d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:21:51.667985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:51.668449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e0fae8dc-ada5-4543-bbdd-134d118a7976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:21:51.669989 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 760/1510] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:21:51 2022] DELETE /identity/v3/projects/c68366c6e0094baf83abe9bb9f1b28d9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:22:01.051993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=62 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:22:01.665442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:23:24.520323 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c279-911e-4c43-8076-a337d0536b35 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:24.520943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c279-911e-4c43-8076-a337d0536b35 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:24.520943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c279-911e-4c43-8076-a337d0536b35 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:24.522314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:23:24.527243 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fb05c-7e88-4e0c-9c15-f9403e390802 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:24.527696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fb05c-7e88-4e0c-9c15-f9403e390802 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:24.527802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fb05c-7e88-4e0c-9c15-f9403e390802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:24.608876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-582fb05c-7e88-4e0c-9c15-f9403e390802 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:24.610137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-582fb05c-7e88-4e0c-9c15-f9403e390802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:24.717813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:24.874557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72c279-911e-4c43-8076-a337d0536b35 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:23:24.876708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9c72c279-911e-4c43-8076-a337d0536b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:25.008076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72c279-911e-4c43-8076-a337d0536b35 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:23:25.013622 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d964e2d-5aee-42a8-9d22-792eccd783d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:23:25.014239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d964e2d-5aee-42a8-9d22-792eccd783d3 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:25.014523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d964e2d-5aee-42a8-9d22-792eccd783d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:25.014801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d964e2d-5aee-42a8-9d22-792eccd783d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:25.024051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d964e2d-5aee-42a8-9d22-792eccd783d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:23:25.025671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d964e2d-5aee-42a8-9d22-792eccd783d3 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:23:25.035463 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 752/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:23:26.137584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad436-1d27-4560-82c2-db805a06b774 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:26.138169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad436-1d27-4560-82c2-db805a06b774 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:26.138169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad436-1d27-4560-82c2-db805a06b774 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:26.139540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:23:26.145821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de739d-0759-4cb8-9f0b-76cf91ac3f7f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:26.146274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de739d-0759-4cb8-9f0b-76cf91ac3f7f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:26.146369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de739d-0759-4cb8-9f0b-76cf91ac3f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:26.166387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-14de739d-0759-4cb8-9f0b-76cf91ac3f7f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:26.167621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-14de739d-0759-4cb8-9f0b-76cf91ac3f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:26.175898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:26.250159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208240b-6ced-4012-9e72-fef7e3589f32 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:26.250579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208240b-6ced-4012-9e72-fef7e3589f32 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:26.250941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208240b-6ced-4012-9e72-fef7e3589f32 None None] PATH_INFO: `/v3` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:26.252308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 763/1516] 10.222.0.42 () {54 vars in 925 bytes} [Thu Sep 22 18:23:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:23:26.259298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248198e-4cc7-493e-be6f-6bb8a8ad2d65 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:26.259710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248198e-4cc7-493e-be6f-6bb8a8ad2d65 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:26.259996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248198e-4cc7-493e-be6f-6bb8a8ad2d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:26.322024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d248198e-4cc7-493e-be6f-6bb8a8ad2d65 None None] MFA Rules not processed for user `e42268a8b5944cbd9508a07c037112e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:26.323232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d248198e-4cc7-493e-be6f-6bb8a8ad2d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:26.330248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208240b-6ced-4012-9e72-fef7e3589f32 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:23:26.345098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208240b-6ced-4012-9e72-fef7e3589f32 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:23:26.352811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8325a-200d-43f3-b445-c6f29f183e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:23:26.353543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8325a-200d-43f3-b445-c6f29f183e1b service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:26.353870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8325a-200d-43f3-b445-c6f29f183e1b service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:26.354150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8325a-200d-43f3-b445-c6f29f183e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:26.364012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8325a-200d-43f3-b445-c6f29f183e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:23:26.366233 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8325a-200d-43f3-b445-c6f29f183e1b service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:23:26.376107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 764/1517] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:23:26.381197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:23:26.400516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 754/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Sep 22 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:35.059255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496e6e-4c8d-45d2-8b16-c53d88605920 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:35.059732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496e6e-4c8d-45d2-8b16-c53d88605920 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:35.059835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496e6e-4c8d-45d2-8b16-c53d88605920 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:35.061145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 765/1519] 10.222.0.61 () {54 vars in 961 bytes} [Thu Sep 22 18:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:23:35.066286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe234-2d97-48b0-b971-0e244412c794 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:35.066706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe234-2d97-48b0-b971-0e244412c794 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:35.066843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe234-2d97-48b0-b971-0e244412c794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:35.086570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e30fe234-2d97-48b0-b971-0e244412c794 None None] MFA Rules not processed for user `e42268a8b5944cbd9508a07c037112e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:35.087750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e30fe234-2d97-48b0-b971-0e244412c794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:35.096150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 755/1520] 10.222.0.61 () {58 vars in 1058 bytes} [Thu Sep 22 18:23:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:35.104535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53496e6e-4c8d-45d2-8b16-c53d88605920 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:23:35.117961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53496e6e-4c8d-45d2-8b16-c53d88605920 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:23:35.122897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a075e83-9475-447c-a124-98e50d4b7e77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:23:35.123495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a075e83-9475-447c-a124-98e50d4b7e77 service placement] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:35.123782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a075e83-9475-447c-a124-98e50d4b7e77 service placement] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:35.124060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a075e83-9475-447c-a124-98e50d4b7e77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:35.132736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a075e83-9475-447c-a124-98e50d4b7e77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:23:35.134384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a075e83-9475-447c-a124-98e50d4b7e77 service placement] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:23:35.144197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 766/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:23:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:23:37.884768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fe0d-334a-46da-a6fa-e0189b74ea55 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:37.885361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fe0d-334a-46da-a6fa-e0189b74ea55 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:37.885472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fe0d-334a-46da-a6fa-e0189b74ea55 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:37.886789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:23:37.893361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbcade-b7a9-4a2c-8686-363aae90fa2e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:37.893829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbcade-b7a9-4a2c-8686-363aae90fa2e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:37.893926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbcade-b7a9-4a2c-8686-363aae90fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:37.915066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5cbbcade-b7a9-4a2c-8686-363aae90fa2e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:37.916651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5cbbcade-b7a9-4a2c-8686-363aae90fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:37.924533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:38.078767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fe0d-334a-46da-a6fa-e0189b74ea55 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:23:38.093814 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fe0d-334a-46da-a6fa-e0189b74ea55 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:23:38.100312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d463bda-8e0b-4d2d-ae12-dfcbceae95f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:23:38.100911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d463bda-8e0b-4d2d-ae12-dfcbceae95f9 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:38.101199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d463bda-8e0b-4d2d-ae12-dfcbceae95f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:38.101502 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d463bda-8e0b-4d2d-ae12-dfcbceae95f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:38.109836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d463bda-8e0b-4d2d-ae12-dfcbceae95f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:23:38.111414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d463bda-8e0b-4d2d-ae12-dfcbceae95f9 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:23:38.120732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 757/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:23:39.189301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30d89-cbc1-4697-ad58-0cee7d32ce3e None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:39.189864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30d89-cbc1-4697-ad58-0cee7d32ce3e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:39.189864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30d89-cbc1-4697-ad58-0cee7d32ce3e None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:39.191228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 18:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:23:39.206747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d5262-17f8-4790-9643-9b3b728c1e2b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:39.206747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d5262-17f8-4790-9643-9b3b728c1e2b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:39.206747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d5262-17f8-4790-9643-9b3b728c1e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:39.217909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6f0d5262-17f8-4790-9643-9b3b728c1e2b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:39.219114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6f0d5262-17f8-4790-9643-9b3b728c1e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:39.227896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 18:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:39.381763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b30d89-cbc1-4697-ad58-0cee7d32ce3e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:23:39.397960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b30d89-cbc1-4697-ad58-0cee7d32ce3e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:23:39.403449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1db18-f467-4bc7-89c8-daaf00caa3d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:23:39.404060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1db18-f467-4bc7-89c8-daaf00caa3d3 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:39.404348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1db18-f467-4bc7-89c8-daaf00caa3d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:39.404627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1db18-f467-4bc7-89c8-daaf00caa3d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:39.413291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1db18-f467-4bc7-89c8-daaf00caa3d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:23:39.414879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1db18-f467-4bc7-89c8-daaf00caa3d3 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:23:39.424398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 769/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:23:43.406575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2389b2-f116-4dda-a7c2-7a7b3d9f47b9 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:43.407178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2389b2-f116-4dda-a7c2-7a7b3d9f47b9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:43.407178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2389b2-f116-4dda-a7c2-7a7b3d9f47b9 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:43.408537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:23:43.414347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae7680-1e07-4595-a67f-8e757fccd575 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:43.414762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae7680-1e07-4595-a67f-8e757fccd575 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:43.414900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae7680-1e07-4595-a67f-8e757fccd575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:43.434730 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-66ae7680-1e07-4595-a67f-8e757fccd575 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:43.435927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-66ae7680-1e07-4595-a67f-8e757fccd575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:43.443872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:43.736643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2389b2-f116-4dda-a7c2-7a7b3d9f47b9 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:23:43.738413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4c2389b2-f116-4dda-a7c2-7a7b3d9f47b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:43.818029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2389b2-f116-4dda-a7c2-7a7b3d9f47b9 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:23:43.821601 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f2f37-c9ba-426a-b179-e8b784defcb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:23:43.822212 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f2f37-c9ba-426a-b179-e8b784defcb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:43.822495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f2f37-c9ba-426a-b179-e8b784defcb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:43.822768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f2f37-c9ba-426a-b179-e8b784defcb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:43.831935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f2f37-c9ba-426a-b179-e8b784defcb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:23:43.833419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f2f37-c9ba-426a-b179-e8b784defcb2 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:23:43.842707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 760/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:23:46.041795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bf994-eb1d-45e5-a979-cf08032a246c None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:46.042365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bf994-eb1d-45e5-a979-cf08032a246c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:46.042365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bf994-eb1d-45e5-a979-cf08032a246c None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:46.043738 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:23:46.049047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4f855-b715-4cbe-91ec-b18850920aac None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:46.049531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4f855-b715-4cbe-91ec-b18850920aac None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:46.049654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4f855-b715-4cbe-91ec-b18850920aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:46.070621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6dc4f855-b715-4cbe-91ec-b18850920aac None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:46.071849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6dc4f855-b715-4cbe-91ec-b18850920aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:46.079725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:46.368508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bf994-eb1d-45e5-a979-cf08032a246c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:23:46.379072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bf994-eb1d-45e5-a979-cf08032a246c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:23:46.383060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216ea7e-b373-4251-b60c-41856a7b7596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:23:46.383650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216ea7e-b373-4251-b60c-41856a7b7596 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:46.383929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216ea7e-b373-4251-b60c-41856a7b7596 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:46.384199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216ea7e-b373-4251-b60c-41856a7b7596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:46.392858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216ea7e-b373-4251-b60c-41856a7b7596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:23:46.394354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216ea7e-b373-4251-b60c-41856a7b7596 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:23:46.404268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 772/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:23:50.129592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e0229-9f85-437c-ade6-07ac4a38a540 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:50.130165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e0229-9f85-437c-ade6-07ac4a38a540 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:50.130165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e0229-9f85-437c-ade6-07ac4a38a540 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:50.131403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:23:50.136545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7c452-03e1-45b5-89d8-227804e46d45 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:50.136959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7c452-03e1-45b5-89d8-227804e46d45 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:50.137091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7c452-03e1-45b5-89d8-227804e46d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:50.144587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:23:50.157542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-86c7c452-03e1-45b5-89d8-227804e46d45 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:50.158748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-86c7c452-03e1-45b5-89d8-227804e46d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:50.167150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:50.471035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e0229-9f85-437c-ade6-07ac4a38a540 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:23:50.472736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a45e0229-9f85-437c-ade6-07ac4a38a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:50.552265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e0229-9f85-437c-ade6-07ac4a38a540 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:23:50.555807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebea75a-a19d-4697-ba04-af67bdf207ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:23:50.556417 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebea75a-a19d-4697-ba04-af67bdf207ba service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:50.556700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebea75a-a19d-4697-ba04-af67bdf207ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:50.556998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebea75a-a19d-4697-ba04-af67bdf207ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:50.566123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebea75a-a19d-4697-ba04-af67bdf207ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:23:50.567557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebea75a-a19d-4697-ba04-af67bdf207ba service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:23:50.577017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 763/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:23:52.828446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a35795-d496-4267-96ff-5e420f305ceb None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:52.828982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a35795-d496-4267-96ff-5e420f305ceb None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:52.829190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a35795-d496-4267-96ff-5e420f305ceb None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:52.830648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 18:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:23:52.836852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4efa7-ddd0-461c-8888-5acdaa771d43 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:52.837306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4efa7-ddd0-461c-8888-5acdaa771d43 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:52.837465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4efa7-ddd0-461c-8888-5acdaa771d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:52.857873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-00e4efa7-ddd0-461c-8888-5acdaa771d43 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:23:52.859196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-00e4efa7-ddd0-461c-8888-5acdaa771d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:52.867633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 18:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:23:53.169883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a35795-d496-4267-96ff-5e420f305ceb None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:23:53.171623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b0a35795-d496-4267-96ff-5e420f305ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:23:53.184727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a35795-d496-4267-96ff-5e420f305ceb None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:23:53.188340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef0121-2baf-43eb-9488-2f0302e712fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:23:53.189001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef0121-2baf-43eb-9488-2f0302e712fa service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:23:53.189401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef0121-2baf-43eb-9488-2f0302e712fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:23:53.189689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef0121-2baf-43eb-9488-2f0302e712fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:23:53.199310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef0121-2baf-43eb-9488-2f0302e712fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:23:53.200838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef0121-2baf-43eb-9488-2f0302e712fa service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:23:53.211413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 775/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:24:02.852979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:24:03.206297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=8 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:24.358297 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a2f9-bcbe-4101-a2e9-bfaef4a28c8f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.358976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a2f9-bcbe-4101-a2e9-bfaef4a28c8f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.358976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a2f9-bcbe-4101-a2e9-bfaef4a28c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.387608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2f89a2f9-bcbe-4101-a2e9-bfaef4a28c8f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.388935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2f89a2f9-bcbe-4101-a2e9-bfaef4a28c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.397800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 765/1540] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.407649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4dc1a-b54c-48c4-82b0-2140d0253ed8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.408264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4dc1a-b54c-48c4-82b0-2140d0253ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.408264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4dc1a-b54c-48c4-82b0-2140d0253ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.435686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3fc4dc1a-b54c-48c4-82b0-2140d0253ed8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.437070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3fc4dc1a-b54c-48c4-82b0-2140d0253ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.448407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 776/1541] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.453682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0aeb6-636e-4f32-819d-3ebbc84a8a25 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.453979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0aeb6-636e-4f32-819d-3ebbc84a8a25 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.454243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0aeb6-636e-4f32-819d-3ebbc84a8a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.464969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4dc1a-b54c-48c4-82b0-2140d0253ed8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:24.491491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4dc1a-b54c-48c4-82b0-2140d0253ed8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:24.497256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba733d-14a6-4048-bb86-3c9294766685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:24.497466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-84b0aeb6-636e-4f32-819d-3ebbc84a8a25 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.497897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba733d-14a6-4048-bb86-3c9294766685 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.498183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba733d-14a6-4048-bb86-3c9294766685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.498468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba733d-14a6-4048-bb86-3c9294766685 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.498583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-84b0aeb6-636e-4f32-819d-3ebbc84a8a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.499131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba733d-14a6-4048-bb86-3c9294766685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:24.499671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba733d-14a6-4048-bb86-3c9294766685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:24.501550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba733d-14a6-4048-bb86-3c9294766685 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:24.511093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 766/1542] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.512786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d8ef9-df6b-42df-8465-9d6ec0b5de3d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.512929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d8ef9-df6b-42df-8465-9d6ec0b5de3d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.513530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d8ef9-df6b-42df-8465-9d6ec0b5de3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.525262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 777/1543] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:24.526051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def39181-ae00-44cb-a6a0-c8640be134f4 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.526387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def39181-ae00-44cb-a6a0-c8640be134f4 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.526661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def39181-ae00-44cb-a6a0-c8640be134f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.552279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a81d8ef9-df6b-42df-8465-9d6ec0b5de3d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.553734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a81d8ef9-df6b-42df-8465-9d6ec0b5de3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.568844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 767/1544] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.569970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c955ae-d4d1-4e79-a878-0e7e9bb782ce None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.570456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c955ae-d4d1-4e79-a878-0e7e9bb782ce None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.570735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c955ae-d4d1-4e79-a878-0e7e9bb782ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.577829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-def39181-ae00-44cb-a6a0-c8640be134f4 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.579060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-def39181-ae00-44cb-a6a0-c8640be134f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.596165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 778/1545] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.600511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def39181-ae00-44cb-a6a0-c8640be134f4 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:24.611818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-85c955ae-d4d1-4e79-a878-0e7e9bb782ce None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.614121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-85c955ae-d4d1-4e79-a878-0e7e9bb782ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.618140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def39181-ae00-44cb-a6a0-c8640be134f4 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:24.630451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e9985-8136-475a-b4c9-83b7d9e9207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:24.631095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e9985-8136-475a-b4c9-83b7d9e9207a admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.631385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e9985-8136-475a-b4c9-83b7d9e9207a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.631663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e9985-8136-475a-b4c9-83b7d9e9207a admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.632451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e9985-8136-475a-b4c9-83b7d9e9207a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:24.633191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 768/1546] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.633513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING py.warnings [None req-365e9985-8136-475a-b4c9-83b7d9e9207a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:25:24.633513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: warnings.warn(msg) Sep 22 18:25:24.633513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: Sep 22 18:25:24.634814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e9985-8136-475a-b4c9-83b7d9e9207a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:24.635465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa048f-c078-44a2-980c-d1bbd280074f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.635981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa048f-c078-44a2-980c-d1bbd280074f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.636467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa048f-c078-44a2-980c-d1bbd280074f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.658554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ccfa048f-c078-44a2-980c-d1bbd280074f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.661076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ccfa048f-c078-44a2-980c-d1bbd280074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.670149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 769/1547] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.671922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48303f75-fdab-4203-9aba-5c9e7917a13a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.672272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48303f75-fdab-4203-9aba-5c9e7917a13a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.672666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48303f75-fdab-4203-9aba-5c9e7917a13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.697602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 779/1548] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:24.698730 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec7a4-02e9-4377-80f9-20607470e721 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.699020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec7a4-02e9-4377-80f9-20607470e721 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.699297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec7a4-02e9-4377-80f9-20607470e721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.701161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-48303f75-fdab-4203-9aba-5c9e7917a13a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.702423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-48303f75-fdab-4203-9aba-5c9e7917a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.719966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c80ec7a4-02e9-4377-80f9-20607470e721 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.721172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c80ec7a4-02e9-4377-80f9-20607470e721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.769649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 770/1549] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.771453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f76ba-bf55-43ce-9368-386a7cb8962c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.771748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f76ba-bf55-43ce-9368-386a7cb8962c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.772309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f76ba-bf55-43ce-9368-386a7cb8962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.786212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 780/1550] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.787133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec7a4-02e9-4377-80f9-20607470e721 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:24.796451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-771f76ba-bf55-43ce-9368-386a7cb8962c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.796649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec7a4-02e9-4377-80f9-20607470e721 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:24.797687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-771f76ba-bf55-43ce-9368-386a7cb8962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.801166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873ef4-5710-4726-b527-eb1b73fac63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:24.801794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873ef4-5710-4726-b527-eb1b73fac63a admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.802092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873ef4-5710-4726-b527-eb1b73fac63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.802354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873ef4-5710-4726-b527-eb1b73fac63a admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.803045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873ef4-5710-4726-b527-eb1b73fac63a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:24.803307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873ef4-5710-4726-b527-eb1b73fac63a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:24.804929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873ef4-5710-4726-b527-eb1b73fac63a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:24.806195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 771/1551] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.807527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6bcc5-00c6-4c1b-a922-8dfbbe7ea342 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.807818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6bcc5-00c6-4c1b-a922-8dfbbe7ea342 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.808127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6bcc5-00c6-4c1b-a922-8dfbbe7ea342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.831446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 781/1552] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:24.831446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66fbd1-64d6-4847-9941-a8d7e8ff7eec None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.831446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66fbd1-64d6-4847-9941-a8d7e8ff7eec None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.831446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66fbd1-64d6-4847-9941-a8d7e8ff7eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.832625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-08f6bcc5-00c6-4c1b-a922-8dfbbe7ea342 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.833969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-08f6bcc5-00c6-4c1b-a922-8dfbbe7ea342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.842355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 772/1553] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.843461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02ab49-c214-417c-bdd3-95d3e7d9e702 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.843816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02ab49-c214-417c-bdd3-95d3e7d9e702 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.844024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02ab49-c214-417c-bdd3-95d3e7d9e702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.849928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-dc66fbd1-64d6-4847-9941-a8d7e8ff7eec None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.851148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dc66fbd1-64d6-4847-9941-a8d7e8ff7eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.859694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 782/1554] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.860483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66fbd1-64d6-4847-9941-a8d7e8ff7eec None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:24.868178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1f02ab49-c214-417c-bdd3-95d3e7d9e702 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.869487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1f02ab49-c214-417c-bdd3-95d3e7d9e702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.871510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66fbd1-64d6-4847-9941-a8d7e8ff7eec None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:24.877552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce6be2-da28-4637-b98c-bddf462866d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:24.878183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce6be2-da28-4637-b98c-bddf462866d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.878470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce6be2-da28-4637-b98c-bddf462866d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.879262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce6be2-da28-4637-b98c-bddf462866d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.879898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce6be2-da28-4637-b98c-bddf462866d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:24.881546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 773/1555] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.882369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02ab49-c214-417c-bdd3-95d3e7d9e702 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:24.882498 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce6be2-da28-4637-b98c-bddf462866d3 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:24.896767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02ab49-c214-417c-bdd3-95d3e7d9e702 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:24.902155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1431b-3ed2-4941-a1c9-bba79a58094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:24.902917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1431b-3ed2-4941-a1c9-bba79a58094c admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.903213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1431b-3ed2-4941-a1c9-bba79a58094c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.903496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1431b-3ed2-4941-a1c9-bba79a58094c admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.904225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1431b-3ed2-4941-a1c9-bba79a58094c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:24.904537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1431b-3ed2-4941-a1c9-bba79a58094c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:24.905650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: WARNING py.warnings [None req-47c1431b-3ed2-4941-a1c9-bba79a58094c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:25:24.905650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: warnings.warn(msg) Sep 22 18:25:24.905650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: Sep 22 18:25:24.906549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1431b-3ed2-4941-a1c9-bba79a58094c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:24.907268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 783/1556] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:24.908208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce6be2-da28-4637-b98c-bddf462866d3 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:24.919297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce6be2-da28-4637-b98c-bddf462866d3 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:24.919522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 774/1557] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:24.920658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e052a80-eb9e-4ae3-89f6-5925f0fdee7c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.920954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e052a80-eb9e-4ae3-89f6-5925f0fdee7c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.921260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e052a80-eb9e-4ae3-89f6-5925f0fdee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.924159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c435453-b9ff-47b6-854b-ec031dcd9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:24.924779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c435453-b9ff-47b6-854b-ec031dcd9807 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.925068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c435453-b9ff-47b6-854b-ec031dcd9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.925411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c435453-b9ff-47b6-854b-ec031dcd9807 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.926063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c435453-b9ff-47b6-854b-ec031dcd9807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:24.926658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c435453-b9ff-47b6-854b-ec031dcd9807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:24.928056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c435453-b9ff-47b6-854b-ec031dcd9807 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:24.940677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 784/1558] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:24.946993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4e052a80-eb9e-4ae3-89f6-5925f0fdee7c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.947140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c435453-b9ff-47b6-854b-ec031dcd9807 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:24.947238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4e052a80-eb9e-4ae3-89f6-5925f0fdee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.952992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c435453-b9ff-47b6-854b-ec031dcd9807 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:24.953559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 775/1559] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.954781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6406-07ab-4a84-bf4c-048bbbc0c385 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.955085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6406-07ab-4a84-bf4c-048bbbc0c385 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.955356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f6406-07ab-4a84-bf4c-048bbbc0c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.960747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f53736-913b-40cf-a692-63f1a5863a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:24.961394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f53736-913b-40cf-a692-63f1a5863a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.961702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f53736-913b-40cf-a692-63f1a5863a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.961977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f53736-913b-40cf-a692-63f1a5863a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:24.962605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f53736-913b-40cf-a692-63f1a5863a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:24.964538 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f53736-913b-40cf-a692-63f1a5863a8a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:24.975248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e22f6406-07ab-4a84-bf4c-048bbbc0c385 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:24.976461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e22f6406-07ab-4a84-bf4c-048bbbc0c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:24.985543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 776/1560] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:24.986364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f6406-07ab-4a84-bf4c-048bbbc0c385 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:24.996196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f6406-07ab-4a84-bf4c-048bbbc0c385 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:24.999759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 785/1561] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:24.999759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0942e-5c6f-4721-a6a8-d3bba5cf7865 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:24.999759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0942e-5c6f-4721-a6a8-d3bba5cf7865 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:24.999759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0942e-5c6f-4721-a6a8-d3bba5cf7865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.019432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f2f0942e-5c6f-4721-a6a8-d3bba5cf7865 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:25.020694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f2f0942e-5c6f-4721-a6a8-d3bba5cf7865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:25.048294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:25.059063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371e12c-44d0-48f6-b081-8f2995090510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.059688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371e12c-44d0-48f6-b081-8f2995090510 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.059980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371e12c-44d0-48f6-b081-8f2995090510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.060257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371e12c-44d0-48f6-b081-8f2995090510 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.060942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371e12c-44d0-48f6-b081-8f2995090510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:25.061280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371e12c-44d0-48f6-b081-8f2995090510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.062964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371e12c-44d0-48f6-b081-8f2995090510 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.075752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 777/1562] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:25.076821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371e12c-44d0-48f6-b081-8f2995090510 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.086895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 786/1563] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:25.087286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371e12c-44d0-48f6-b081-8f2995090510 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.087719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0942e-5c6f-4721-a6a8-d3bba5cf7865 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.092658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf13d-e284-4509-b217-8c82e039d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.093493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf13d-e284-4509-b217-8c82e039d9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.093857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf13d-e284-4509-b217-8c82e039d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.094133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edf13d-e284-4509-b217-8c82e039d9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.094789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf13d-e284-4509-b217-8c82e039d9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.096447 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edf13d-e284-4509-b217-8c82e039d9c1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.097667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0942e-5c6f-4721-a6a8-d3bba5cf7865 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.102869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de1f2d-a2c6-4b9b-bf37-774853e4aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.103481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de1f2d-a2c6-4b9b-bf37-774853e4aa63 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.103766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de1f2d-a2c6-4b9b-bf37-774853e4aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.104042 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de1f2d-a2c6-4b9b-bf37-774853e4aa63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.104677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de1f2d-a2c6-4b9b-bf37-774853e4aa63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.106638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de1f2d-a2c6-4b9b-bf37-774853e4aa63 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.108352 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 778/1564] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:25.109130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf13d-e284-4509-b217-8c82e039d9c1 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.115895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:25.120387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edf13d-e284-4509-b217-8c82e039d9c1 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.126662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40835bd4-9519-4a00-8b94-29a500e293a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.127818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40835bd4-9519-4a00-8b94-29a500e293a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.128339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40835bd4-9519-4a00-8b94-29a500e293a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.129451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40835bd4-9519-4a00-8b94-29a500e293a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.130801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40835bd4-9519-4a00-8b94-29a500e293a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.134371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40835bd4-9519-4a00-8b94-29a500e293a9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.135937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 787/1565] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.136943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de1f2d-a2c6-4b9b-bf37-774853e4aa63 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.169038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 779/1566] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.169038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40835bd4-9519-4a00-8b94-29a500e293a9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.201842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de1f2d-a2c6-4b9b-bf37-774853e4aa63 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.235391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40835bd4-9519-4a00-8b94-29a500e293a9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.241228 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c250b7a-edf9-4238-b97d-f3ccec9dc42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.241972 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250b7a-edf9-4238-b97d-f3ccec9dc42f admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.242446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250b7a-edf9-4238-b97d-f3ccec9dc42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.242807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250b7a-edf9-4238-b97d-f3ccec9dc42f admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.243659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c250b7a-edf9-4238-b97d-f3ccec9dc42f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:25.244331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c250b7a-edf9-4238-b97d-f3ccec9dc42f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.246967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c250b7a-edf9-4238-b97d-f3ccec9dc42f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.271309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 780/1567] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:25.272694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c250b7a-edf9-4238-b97d-f3ccec9dc42f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.274628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b7602-596a-41e1-b935-eaeb2bb981b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.275641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b7602-596a-41e1-b935-eaeb2bb981b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.276115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b7602-596a-41e1-b935-eaeb2bb981b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.276586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b7602-596a-41e1-b935-eaeb2bb981b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.277738 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b7602-596a-41e1-b935-eaeb2bb981b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:25.278463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b7602-596a-41e1-b935-eaeb2bb981b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.281182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b7602-596a-41e1-b935-eaeb2bb981b6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.290245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c250b7a-edf9-4238-b97d-f3ccec9dc42f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.297197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a7576-d6f0-4430-9164-237a986708fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.298193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a7576-d6f0-4430-9164-237a986708fe admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.298636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a7576-d6f0-4430-9164-237a986708fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.299080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a7576-d6f0-4430-9164-237a986708fe admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.300102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a7576-d6f0-4430-9164-237a986708fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.301915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 788/1568] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:25.302425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: WARNING py.warnings [None req-db8a7576-d6f0-4430-9164-237a986708fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:25:25.302425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: warnings.warn(msg) Sep 22 18:25:25.302425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: Sep 22 18:25:25.303033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b7602-596a-41e1-b935-eaeb2bb981b6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.304540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a7576-d6f0-4430-9164-237a986708fe admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.318958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b7602-596a-41e1-b935-eaeb2bb981b6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.326056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47b238-bd5e-4168-97db-c6f71bc0725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.327098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47b238-bd5e-4168-97db-c6f71bc0725f admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.327593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47b238-bd5e-4168-97db-c6f71bc0725f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.328035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47b238-bd5e-4168-97db-c6f71bc0725f admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.329277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47b238-bd5e-4168-97db-c6f71bc0725f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.332925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47b238-bd5e-4168-97db-c6f71bc0725f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.334311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 781/1569] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/users => generated 278 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.339438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a7576-d6f0-4430-9164-237a986708fe admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.357309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a7576-d6f0-4430-9164-237a986708fe admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.364730 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61d8e4-1be8-4beb-8ed3-acb76ac9c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.365583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d8e4-1be8-4beb-8ed3-acb76ac9c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.365869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d8e4-1be8-4beb-8ed3-acb76ac9c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.366184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d8e4-1be8-4beb-8ed3-acb76ac9c7d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.366975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61d8e4-1be8-4beb-8ed3-acb76ac9c7d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:25.367401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61d8e4-1be8-4beb-8ed3-acb76ac9c7d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.368997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61d8e4-1be8-4beb-8ed3-acb76ac9c7d3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.376285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 789/1570] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/projects => generated 393 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.377906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47b238-bd5e-4168-97db-c6f71bc0725f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.382205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 782/1571] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:25.383026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61d8e4-1be8-4beb-8ed3-acb76ac9c7d3 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.394109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61d8e4-1be8-4beb-8ed3-acb76ac9c7d3 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.418246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:25.452610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47b238-bd5e-4168-97db-c6f71bc0725f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.453315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768463bb-eb94-4a56-906a-b66f50484c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.453962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768463bb-eb94-4a56-906a-b66f50484c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.454247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768463bb-eb94-4a56-906a-b66f50484c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.454527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768463bb-eb94-4a56-906a-b66f50484c81 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.455149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768463bb-eb94-4a56-906a-b66f50484c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.457070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768463bb-eb94-4a56-906a-b66f50484c81 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.457460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0358a4-aa14-40ea-a50e-697a570745e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.458075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0358a4-aa14-40ea-a50e-697a570745e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.458362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0358a4-aa14-40ea-a50e-697a570745e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.458642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0358a4-aa14-40ea-a50e-697a570745e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.459300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0358a4-aa14-40ea-a50e-697a570745e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.460885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0358a4-aa14-40ea-a50e-697a570745e2 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.473299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 790/1572] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:25.474680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0358a4-aa14-40ea-a50e-697a570745e2 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.488708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0358a4-aa14-40ea-a50e-697a570745e2 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.490432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 783/1573] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.491224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768463bb-eb94-4a56-906a-b66f50484c81 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.493619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57a6f-3120-489d-b857-0a971c0036cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.494230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57a6f-3120-489d-b857-0a971c0036cc admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.494511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57a6f-3120-489d-b857-0a971c0036cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.494797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57a6f-3120-489d-b857-0a971c0036cc admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.495426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57a6f-3120-489d-b857-0a971c0036cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.497395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57a6f-3120-489d-b857-0a971c0036cc admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.501581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768463bb-eb94-4a56-906a-b66f50484c81 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.506328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb8caf-ae25-43bb-a56b-dd53f06fac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.506945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb8caf-ae25-43bb-a56b-dd53f06fac1a admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.507226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb8caf-ae25-43bb-a56b-dd53f06fac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.507542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb8caf-ae25-43bb-a56b-dd53f06fac1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.508283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb8caf-ae25-43bb-a56b-dd53f06fac1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.510737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb8caf-ae25-43bb-a56b-dd53f06fac1a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.523158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 791/1574] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.523158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57a6f-3120-489d-b857-0a971c0036cc admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.530683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57a6f-3120-489d-b857-0a971c0036cc admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.536175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0997636-7333-46bf-92ac-8e1d67e3c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.536800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997636-7333-46bf-92ac-8e1d67e3c057 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.537079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997636-7333-46bf-92ac-8e1d67e3c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.537394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997636-7333-46bf-92ac-8e1d67e3c057 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.538017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0997636-7333-46bf-92ac-8e1d67e3c057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.539903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0997636-7333-46bf-92ac-8e1d67e3c057 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.543766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 784/1575] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.544679 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb8caf-ae25-43bb-a56b-dd53f06fac1a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.561963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:25.583868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 792/1576] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.583868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0997636-7333-46bf-92ac-8e1d67e3c057 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.620251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb8caf-ae25-43bb-a56b-dd53f06fac1a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.643978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0997636-7333-46bf-92ac-8e1d67e3c057 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.648685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda820c7-d81d-4abe-b6cd-dd8ef90d12e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.649325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda820c7-d81d-4abe-b6cd-dd8ef90d12e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.649613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda820c7-d81d-4abe-b6cd-dd8ef90d12e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.649888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda820c7-d81d-4abe-b6cd-dd8ef90d12e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.650515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda820c7-d81d-4abe-b6cd-dd8ef90d12e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.652424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda820c7-d81d-4abe-b6cd-dd8ef90d12e7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.678505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 793/1577] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.679334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda820c7-d81d-4abe-b6cd-dd8ef90d12e7 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.679548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89073c37-418a-41d0-969c-38e301cb9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.680336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073c37-418a-41d0-969c-38e301cb9dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.680916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073c37-418a-41d0-969c-38e301cb9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.681284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073c37-418a-41d0-969c-38e301cb9dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.682054 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89073c37-418a-41d0-969c-38e301cb9dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.683655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89073c37-418a-41d0-969c-38e301cb9dd0 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.689679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda820c7-d81d-4abe-b6cd-dd8ef90d12e7 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.694433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 785/1578] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:25.695089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880985-c550-4cb0-81d6-c937e7c5489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.695386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89073c37-418a-41d0-969c-38e301cb9dd0 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.695621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880985-c550-4cb0-81d6-c937e7c5489e admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.695910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880985-c550-4cb0-81d6-c937e7c5489e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.696187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880985-c550-4cb0-81d6-c937e7c5489e admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.696814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880985-c550-4cb0-81d6-c937e7c5489e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.698820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880985-c550-4cb0-81d6-c937e7c5489e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.705531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89073c37-418a-41d0-969c-38e301cb9dd0 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.710828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79418c9-ce84-4f3e-9485-8ed3e5c2dd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.711754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79418c9-ce84-4f3e-9485-8ed3e5c2dd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.712039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79418c9-ce84-4f3e-9485-8ed3e5c2dd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.712317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79418c9-ce84-4f3e-9485-8ed3e5c2dd4b admin admin] PATH_INFO: `/v3/projects/7627f15ced54400181858ae982f71d7c/users/1b499b317e884632a0a1f69959752e9d/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.728468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 794/1579] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.730166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79418c9-ce84-4f3e-9485-8ed3e5c2dd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7627f15ced54400181858ae982f71d7c, user_id=1b499b317e884632a0a1f69959752e9d, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.730301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880985-c550-4cb0-81d6-c937e7c5489e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.732859 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79418c9-ce84-4f3e-9485-8ed3e5c2dd4b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.746326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 786/1580] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:25 2022] PUT /identity/v3/projects/7627f15ced54400181858ae982f71d7c/users/1b499b317e884632a0a1f69959752e9d/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:25.747290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79418c9-ce84-4f3e-9485-8ed3e5c2dd4b admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.791486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:25.804477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880985-c550-4cb0-81d6-c937e7c5489e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.809383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aee53-8d93-4523-b4b6-28bba931bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.810002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aee53-8d93-4523-b4b6-28bba931bc09 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.810312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aee53-8d93-4523-b4b6-28bba931bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.810584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aee53-8d93-4523-b4b6-28bba931bc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.811227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aee53-8d93-4523-b4b6-28bba931bc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.811946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79418c9-ce84-4f3e-9485-8ed3e5c2dd4b admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.812861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aee53-8d93-4523-b4b6-28bba931bc09 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.816589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6461a-b3b8-4ed4-b064-4d750fc2862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.817192 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6461a-b3b8-4ed4-b064-4d750fc2862c admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.817506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6461a-b3b8-4ed4-b064-4d750fc2862c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.817780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6461a-b3b8-4ed4-b064-4d750fc2862c admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.818424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6461a-b3b8-4ed4-b064-4d750fc2862c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.819997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6461a-b3b8-4ed4-b064-4d750fc2862c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.822862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 795/1581] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:25.823746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aee53-8d93-4523-b4b6-28bba931bc09 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.834400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 787/1582] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:25.834400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6461a-b3b8-4ed4-b064-4d750fc2862c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.834688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aee53-8d93-4523-b4b6-28bba931bc09 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.839108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb63424-04b1-431a-abc8-755da1531ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.839769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb63424-04b1-431a-abc8-755da1531ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.840049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb63424-04b1-431a-abc8-755da1531ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.840329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb63424-04b1-431a-abc8-755da1531ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.841116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb63424-04b1-431a-abc8-755da1531ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.842813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6461a-b3b8-4ed4-b064-4d750fc2862c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.843367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb63424-04b1-431a-abc8-755da1531ff9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.848049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258d31-4a2a-4dc2-8cdb-9f64044dda6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.848651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258d31-4a2a-4dc2-8cdb-9f64044dda6e admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.848927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258d31-4a2a-4dc2-8cdb-9f64044dda6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.849196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258d31-4a2a-4dc2-8cdb-9f64044dda6e admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.849848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0258d31-4a2a-4dc2-8cdb-9f64044dda6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.852023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0258d31-4a2a-4dc2-8cdb-9f64044dda6e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.867951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 796/1583] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.869211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb63424-04b1-431a-abc8-755da1531ff9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.879664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 788/1584] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.879664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258d31-4a2a-4dc2-8cdb-9f64044dda6e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.879923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb63424-04b1-431a-abc8-755da1531ff9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.884762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c80e12-95cf-4d16-8f61-0f79426e32d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.885421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c80e12-95cf-4d16-8f61-0f79426e32d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.885775 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c80e12-95cf-4d16-8f61-0f79426e32d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.886089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c80e12-95cf-4d16-8f61-0f79426e32d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.886767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c80e12-95cf-4d16-8f61-0f79426e32d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.888159 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258d31-4a2a-4dc2-8cdb-9f64044dda6e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.888489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c80e12-95cf-4d16-8f61-0f79426e32d9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.893095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35b08b-b308-4078-975d-a4335ba2834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.893683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35b08b-b308-4078-975d-a4335ba2834f admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.893966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35b08b-b308-4078-975d-a4335ba2834f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.894911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35b08b-b308-4078-975d-a4335ba2834f admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.895494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35b08b-b308-4078-975d-a4335ba2834f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.897095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35b08b-b308-4078-975d-a4335ba2834f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.900822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 797/1585] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:25.901694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c80e12-95cf-4d16-8f61-0f79426e32d9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.905595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:25.912766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 789/1586] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:25.912766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7b1e-ab2b-4878-b7b6-e67b7f8f6961 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.912766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7b1e-ab2b-4878-b7b6-e67b7f8f6961 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.912766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e7b1e-ab2b-4878-b7b6-e67b7f8f6961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.914333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c80e12-95cf-4d16-8f61-0f79426e32d9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.919337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcd3f5-d4b6-421e-9cca-30b9e46eda30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.919959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcd3f5-d4b6-421e-9cca-30b9e46eda30 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.920242 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcd3f5-d4b6-421e-9cca-30b9e46eda30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.920513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcd3f5-d4b6-421e-9cca-30b9e46eda30 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.921151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcd3f5-d4b6-421e-9cca-30b9e46eda30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.923135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcd3f5-d4b6-421e-9cca-30b9e46eda30 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.940950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ba4e7b1e-ab2b-4878-b7b6-e67b7f8f6961 None None] MFA Rules not processed for user `1b499b317e884632a0a1f69959752e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:25.942453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ba4e7b1e-ab2b-4878-b7b6-e67b7f8f6961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:25.944819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 798/1587] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:25.945781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcd3f5-d4b6-421e-9cca-30b9e46eda30 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.955598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcd3f5-d4b6-421e-9cca-30b9e46eda30 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.960681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d161-d0a0-44ae-ab3f-964d981c2f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.961304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d161-d0a0-44ae-ab3f-964d981c2f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.961584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d161-d0a0-44ae-ab3f-964d981c2f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.961859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d161-d0a0-44ae-ab3f-964d981c2f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.962485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4d161-d0a0-44ae-ab3f-964d981c2f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.964059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4d161-d0a0-44ae-ab3f-964d981c2f65 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:25.974744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 799/1588] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:25.974744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d161-d0a0-44ae-ab3f-964d981c2f65 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:25.985215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d161-d0a0-44ae-ab3f-964d981c2f65 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:25.989851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e62c9-0a3b-4dd6-883a-79ecb407a618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:25.990449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e62c9-0a3b-4dd6-883a-79ecb407a618 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:25.990729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e62c9-0a3b-4dd6-883a-79ecb407a618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:25.990998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e62c9-0a3b-4dd6-883a-79ecb407a618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:25.991627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e62c9-0a3b-4dd6-883a-79ecb407a618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:25.993203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e62c9-0a3b-4dd6-883a-79ecb407a618 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.003911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 800/1589] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:26.004724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e62c9-0a3b-4dd6-883a-79ecb407a618 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.012315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 790/1590] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:26.013300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e7b1e-ab2b-4878-b7b6-e67b7f8f6961 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.015783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e62c9-0a3b-4dd6-883a-79ecb407a618 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.021718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab7173-f6c4-4a25-a51a-67ec0a2afab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.022372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab7173-f6c4-4a25-a51a-67ec0a2afab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.022668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab7173-f6c4-4a25-a51a-67ec0a2afab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.022946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab7173-f6c4-4a25-a51a-67ec0a2afab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.023629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab7173-f6c4-4a25-a51a-67ec0a2afab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.025269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab7173-f6c4-4a25-a51a-67ec0a2afab2 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.026886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e7b1e-ab2b-4878-b7b6-e67b7f8f6961 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.031404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb2af-141e-4ae2-8511-891629efa8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.032014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb2af-141e-4ae2-8511-891629efa8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.032311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb2af-141e-4ae2-8511-891629efa8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.032567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb2af-141e-4ae2-8511-891629efa8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.033403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb2af-141e-4ae2-8511-891629efa8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.035045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb2af-141e-4ae2-8511-891629efa8a1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.037485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 801/1591] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:26.038563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab7173-f6c4-4a25-a51a-67ec0a2afab2 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.051133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 791/1592] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:26.051133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb2af-141e-4ae2-8511-891629efa8a1 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.054512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab7173-f6c4-4a25-a51a-67ec0a2afab2 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.061463 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb2af-141e-4ae2-8511-891629efa8a1 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.061974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56675be-5144-4193-be9a-a576ae4aaba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.062636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56675be-5144-4193-be9a-a576ae4aaba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.062908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56675be-5144-4193-be9a-a576ae4aaba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.063183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56675be-5144-4193-be9a-a576ae4aaba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.063959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56675be-5144-4193-be9a-a576ae4aaba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.065506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56675be-5144-4193-be9a-a576ae4aaba6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.068638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3e64d-8299-4cdf-ad34-6ed64080aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.069424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3e64d-8299-4cdf-ad34-6ed64080aa15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.069711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3e64d-8299-4cdf-ad34-6ed64080aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.069996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3e64d-8299-4cdf-ad34-6ed64080aa15 admin admin] PATH_INFO: `/v3/projects/b298475976aa454ab4224fc3ddeb81e9/users/d8465173ae514333b70180a7c2c06968/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.076372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 802/1593] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:26.077191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56675be-5144-4193-be9a-a576ae4aaba6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.087106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3e64d-8299-4cdf-ad34-6ed64080aa15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b298475976aa454ab4224fc3ddeb81e9, user_id=d8465173ae514333b70180a7c2c06968, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.087495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56675be-5144-4193-be9a-a576ae4aaba6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.089947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3e64d-8299-4cdf-ad34-6ed64080aa15 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.092285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708174f4-7030-4ccf-8827-cb0aaff5bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.092920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708174f4-7030-4ccf-8827-cb0aaff5bc6e admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.093212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708174f4-7030-4ccf-8827-cb0aaff5bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.093627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708174f4-7030-4ccf-8827-cb0aaff5bc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.094271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708174f4-7030-4ccf-8827-cb0aaff5bc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.096201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708174f4-7030-4ccf-8827-cb0aaff5bc6e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.103964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 792/1594] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:26 2022] PUT /identity/v3/projects/b298475976aa454ab4224fc3ddeb81e9/users/d8465173ae514333b70180a7c2c06968/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:26.104822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3e64d-8299-4cdf-ad34-6ed64080aa15 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.111118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 803/1595] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:26.111783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708174f4-7030-4ccf-8827-cb0aaff5bc6e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.122294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708174f4-7030-4ccf-8827-cb0aaff5bc6e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.168331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3e64d-8299-4cdf-ad34-6ed64080aa15 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.172944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dbaf9-5b91-48d5-8ff2-abae495577ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.173692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dbaf9-5b91-48d5-8ff2-abae495577ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.173973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dbaf9-5b91-48d5-8ff2-abae495577ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.174245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dbaf9-5b91-48d5-8ff2-abae495577ea admin admin] PATH_INFO: `/v3/projects/6f21a188f8ab4f61980edbbae4bec22b/users/84194be302944432b193bdbfd2e6ddf7/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.180024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61551c14-bbc7-4d9e-8c66-aa6f510091f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.180733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551c14-bbc7-4d9e-8c66-aa6f510091f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.181020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551c14-bbc7-4d9e-8c66-aa6f510091f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.181350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551c14-bbc7-4d9e-8c66-aa6f510091f2 admin admin] PATH_INFO: `/v3/projects/2d3f502ab01f49dd909d482c8e6aa39d/users/626b85e5875b4d47b410f4f43aca0497/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.192800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dbaf9-5b91-48d5-8ff2-abae495577ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f21a188f8ab4f61980edbbae4bec22b, user_id=84194be302944432b193bdbfd2e6ddf7, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.195584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dbaf9-5b91-48d5-8ff2-abae495577ea admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.196892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61551c14-bbc7-4d9e-8c66-aa6f510091f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3f502ab01f49dd909d482c8e6aa39d, user_id=626b85e5875b4d47b410f4f43aca0497, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.197977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING py.warnings [None req-61551c14-bbc7-4d9e-8c66-aa6f510091f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:25:26.197977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: warnings.warn(msg) Sep 22 18:25:26.197977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: Sep 22 18:25:26.200068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61551c14-bbc7-4d9e-8c66-aa6f510091f2 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.217265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 804/1596] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:26 2022] PUT /identity/v3/projects/2d3f502ab01f49dd909d482c8e6aa39d/users/626b85e5875b4d47b410f4f43aca0497/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:26.218062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 793/1597] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:26 2022] PUT /identity/v3/projects/6f21a188f8ab4f61980edbbae4bec22b/users/84194be302944432b193bdbfd2e6ddf7/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:26.218955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dbaf9-5b91-48d5-8ff2-abae495577ea admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.226060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61551c14-bbc7-4d9e-8c66-aa6f510091f2 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.261557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:26.264263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:26.288312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dbaf9-5b91-48d5-8ff2-abae495577ea admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.293394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75e0c4-10a6-4413-95b2-014b7ce15faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.294034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75e0c4-10a6-4413-95b2-014b7ce15faf admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.294310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75e0c4-10a6-4413-95b2-014b7ce15faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.294580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75e0c4-10a6-4413-95b2-014b7ce15faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.295216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75e0c4-10a6-4413-95b2-014b7ce15faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.295497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61551c14-bbc7-4d9e-8c66-aa6f510091f2 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.296801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75e0c4-10a6-4413-95b2-014b7ce15faf admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.301293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52847947-1bf1-41fc-92a4-6ce4dee94e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.301912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52847947-1bf1-41fc-92a4-6ce4dee94e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.302199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52847947-1bf1-41fc-92a4-6ce4dee94e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.302864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52847947-1bf1-41fc-92a4-6ce4dee94e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.303125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52847947-1bf1-41fc-92a4-6ce4dee94e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.304714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52847947-1bf1-41fc-92a4-6ce4dee94e71 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.310695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 794/1598] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:26.310695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12712ae8-91e6-42ab-890e-841b116d991f None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.310695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12712ae8-91e6-42ab-890e-841b116d991f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.310695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12712ae8-91e6-42ab-890e-841b116d991f None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.310695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 795/1599] 10.222.0.61 () {54 vars in 961 bytes} [Thu Sep 22 18:25:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:25:26.311172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12712ae8-91e6-42ab-890e-841b116d991f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.320026 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 805/1600] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:26.320026 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52847947-1bf1-41fc-92a4-6ce4dee94e71 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.326437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12712ae8-91e6-42ab-890e-841b116d991f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.327993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52847947-1bf1-41fc-92a4-6ce4dee94e71 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.332003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d97bc-540e-46a9-bfdd-6f15d6e5d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.332730 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35a2ea-e44b-4afa-b4a9-b2d02b6138c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.332848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d97bc-540e-46a9-bfdd-6f15d6e5d991 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.333037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d97bc-540e-46a9-bfdd-6f15d6e5d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.333358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35a2ea-e44b-4afa-b4a9-b2d02b6138c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.333472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d97bc-540e-46a9-bfdd-6f15d6e5d991 admin admin] PATH_INFO: `/v3/projects/5099fd88fb0d40e0a5afe383f13ed5f6/users/36d7b059ff874d0db44ceecb2f95830c/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.333654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35a2ea-e44b-4afa-b4a9-b2d02b6138c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.333935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35a2ea-e44b-4afa-b4a9-b2d02b6138c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.334574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35a2ea-e44b-4afa-b4a9-b2d02b6138c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.336171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35a2ea-e44b-4afa-b4a9-b2d02b6138c4 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.347805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 806/1601] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:26.349310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb6b63-f25b-47a1-9697-10b1c4ccc36b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.353179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb6b63-f25b-47a1-9697-10b1c4ccc36b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.353179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb6b63-f25b-47a1-9697-10b1c4ccc36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.353585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d97bc-540e-46a9-bfdd-6f15d6e5d991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5099fd88fb0d40e0a5afe383f13ed5f6, user_id=36d7b059ff874d0db44ceecb2f95830c, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.355996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d97bc-540e-46a9-bfdd-6f15d6e5d991 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.371430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 796/1602] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:26 2022] PUT /identity/v3/projects/5099fd88fb0d40e0a5afe383f13ed5f6/users/36d7b059ff874d0db44ceecb2f95830c/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:26.372680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975c26d-80c2-4290-b492-f857862dca99 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.372960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975c26d-80c2-4290-b492-f857862dca99 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.373286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975c26d-80c2-4290-b492-f857862dca99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.390141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-faeb6b63-f25b-47a1-9697-10b1c4ccc36b None None] MFA Rules not processed for user `d8465173ae514333b70180a7c2c06968`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:26.391640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-faeb6b63-f25b-47a1-9697-10b1c4ccc36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:26.395683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6975c26d-80c2-4290-b492-f857862dca99 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:26.396856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6975c26d-80c2-4290-b492-f857862dca99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:26.456331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 807/1603] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:26.457822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 797/1604] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:26.458659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975c26d-80c2-4290-b492-f857862dca99 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.461381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55828-7e21-4d34-bada-0313af883b3b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.461477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55828-7e21-4d34-bada-0313af883b3b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.461735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55828-7e21-4d34-bada-0313af883b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.470980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975c26d-80c2-4290-b492-f857862dca99 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.477447 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb14d-5356-492c-a495-b70155dfe519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.478117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb14d-5356-492c-a495-b70155dfe519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.478399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb14d-5356-492c-a495-b70155dfe519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.478675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb14d-5356-492c-a495-b70155dfe519 admin admin] PATH_INFO: `/v3/projects/4a75a45a96f84c34b553e519a1f6005c/users/c334003dcc634b4c86ba14c542fb60aa/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.482913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-a7f55828-7e21-4d34-bada-0313af883b3b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:26.484120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a7f55828-7e21-4d34-bada-0313af883b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:26.496162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 808/1605] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:26.496355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb14d-5356-492c-a495-b70155dfe519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a75a45a96f84c34b553e519a1f6005c, user_id=c334003dcc634b4c86ba14c542fb60aa, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.496471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c70f92-5dd2-4461-b1e1-70419c402f04 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.496471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c70f92-5dd2-4461-b1e1-70419c402f04 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.496471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c70f92-5dd2-4461-b1e1-70419c402f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.496891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb14d-5356-492c-a495-b70155dfe519 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.517318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 798/1606] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:26 2022] PUT /identity/v3/projects/4a75a45a96f84c34b553e519a1f6005c/users/c334003dcc634b4c86ba14c542fb60aa/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:26.517318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb14d-5356-492c-a495-b70155dfe519 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.540590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f2c70f92-5dd2-4461-b1e1-70419c402f04 None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:26.541853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f2c70f92-5dd2-4461-b1e1-70419c402f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:26.580592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb14d-5356-492c-a495-b70155dfe519 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.585767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d234e9-f41f-47da-bc63-d0768bf33242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.586434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d234e9-f41f-47da-bc63-d0768bf33242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.586719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d234e9-f41f-47da-bc63-d0768bf33242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.586996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d234e9-f41f-47da-bc63-d0768bf33242 admin admin] PATH_INFO: `/v3/projects/699c48287b9443489f3fb6a673bb6a0e/users/042a00546473489fa1e747f186930f54/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.602309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d234e9-f41f-47da-bc63-d0768bf33242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699c48287b9443489f3fb6a673bb6a0e, user_id=042a00546473489fa1e747f186930f54, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.604963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d234e9-f41f-47da-bc63-d0768bf33242 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.614175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 809/1607] 10.222.0.61 () {58 vars in 1058 bytes} [Thu Sep 22 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:26.615092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c70f92-5dd2-4461-b1e1-70419c402f04 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.619030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 799/1608] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:26 2022] PUT /identity/v3/projects/699c48287b9443489f3fb6a673bb6a0e/users/042a00546473489fa1e747f186930f54/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:26.620196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22884e85-13ba-4ba5-bc27-376664f108be None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.620553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22884e85-13ba-4ba5-bc27-376664f108be None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.620897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22884e85-13ba-4ba5-bc27-376664f108be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.639262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c70f92-5dd2-4461-b1e1-70419c402f04 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.640978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-22884e85-13ba-4ba5-bc27-376664f108be None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:26.642328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-22884e85-13ba-4ba5-bc27-376664f108be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:26.647159 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:26.653554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:26.701362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46a9fd-1171-4b09-8bb5-9b8cea2a77df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.702037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46a9fd-1171-4b09-8bb5-9b8cea2a77df admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.702320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46a9fd-1171-4b09-8bb5-9b8cea2a77df admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.702597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46a9fd-1171-4b09-8bb5-9b8cea2a77df admin admin] PATH_INFO: `/v3/projects/510e189fb50e4e2f9c91ad44416c095b/users/0077a4d1cc544b66abb0ca37ab955c73/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.715186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 800/1609] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:26.715944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22884e85-13ba-4ba5-bc27-376664f108be None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.720219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46a9fd-1171-4b09-8bb5-9b8cea2a77df admin admin] RBAC: Authorizing `identity:create_grant(project_id=510e189fb50e4e2f9c91ad44416c095b, user_id=0077a4d1cc544b66abb0ca37ab955c73, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.723034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46a9fd-1171-4b09-8bb5-9b8cea2a77df admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.726287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22884e85-13ba-4ba5-bc27-376664f108be None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.731909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023f404-37c4-47c3-8293-60b3b9076018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.732525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023f404-37c4-47c3-8293-60b3b9076018 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.732810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023f404-37c4-47c3-8293-60b3b9076018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.733088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023f404-37c4-47c3-8293-60b3b9076018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.733781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023f404-37c4-47c3-8293-60b3b9076018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.735693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023f404-37c4-47c3-8293-60b3b9076018 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.739318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 810/1610] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:26 2022] PUT /identity/v3/projects/510e189fb50e4e2f9c91ad44416c095b/users/0077a4d1cc544b66abb0ca37ab955c73/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:26.739318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46a9fd-1171-4b09-8bb5-9b8cea2a77df admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.746484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3f46a9fd-1171-4b09-8bb5-9b8cea2a77df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:26.772867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 801/1611] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:26 2022] POST /identity/v3/projects => generated 357 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:26.773705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023f404-37c4-47c3-8293-60b3b9076018 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.775305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6023f404-37c4-47c3-8293-60b3b9076018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:26.813885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46a9fd-1171-4b09-8bb5-9b8cea2a77df admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.845839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023f404-37c4-47c3-8293-60b3b9076018 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:26.850296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546a583-deab-43c3-bdc7-eaa31d387544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.850915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546a583-deab-43c3-bdc7-eaa31d387544 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.851194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546a583-deab-43c3-bdc7-eaa31d387544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.851465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546a583-deab-43c3-bdc7-eaa31d387544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.868209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d8b77-9538-47a2-be0c-dfefd028ab03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:26.868859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d8b77-9538-47a2-be0c-dfefd028ab03 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.869170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d8b77-9538-47a2-be0c-dfefd028ab03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.869724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d8b77-9538-47a2-be0c-dfefd028ab03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.930643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546a583-deab-43c3-bdc7-eaa31d387544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.932094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546a583-deab-43c3-bdc7-eaa31d387544 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.939174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d8b77-9538-47a2-be0c-dfefd028ab03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:26.940782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d8b77-9538-47a2-be0c-dfefd028ab03 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:26.943243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 802/1612] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:26.944751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caaf09-d981-4e88-848a-a4b48a1aab1d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.945052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caaf09-d981-4e88-848a-a4b48a1aab1d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.945381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caaf09-d981-4e88-848a-a4b48a1aab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.951818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 811/1613] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:26.952944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b519-1438-4d1b-84ad-2f16d8a3b956 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:26.953230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b519-1438-4d1b-84ad-2f16d8a3b956 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:26.953534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068b519-1438-4d1b-84ad-2f16d8a3b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:26.966184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-91caaf09-d981-4e88-848a-a4b48a1aab1d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:26.967326 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:26.967511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-91caaf09-d981-4e88-848a-a4b48a1aab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:26.979895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 803/1614] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:26.979895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91caaf09-d981-4e88-848a-a4b48a1aab1d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:26.985593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5068b519-1438-4d1b-84ad-2f16d8a3b956 None None] MFA Rules not processed for user `042a00546473489fa1e747f186930f54`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:26.987151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5068b519-1438-4d1b-84ad-2f16d8a3b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:27.027426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:27.072083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 812/1615] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:27.072083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068b519-1438-4d1b-84ad-2f16d8a3b956 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.073639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91caaf09-d981-4e88-848a-a4b48a1aab1d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.080751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb66234-b6de-438e-aed8-e8042b83db3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.081166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068b519-1438-4d1b-84ad-2f16d8a3b956 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.082264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb66234-b6de-438e-aed8-e8042b83db3e service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.082638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb66234-b6de-438e-aed8-e8042b83db3e service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.083050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb66234-b6de-438e-aed8-e8042b83db3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.086258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887ce12-6aa1-4d45-a073-cd4a9d0be070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.086882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887ce12-6aa1-4d45-a073-cd4a9d0be070 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.087175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887ce12-6aa1-4d45-a073-cd4a9d0be070 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.087448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887ce12-6aa1-4d45-a073-cd4a9d0be070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.099420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887ce12-6aa1-4d45-a073-cd4a9d0be070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.100871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887ce12-6aa1-4d45-a073-cd4a9d0be070 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:27.112455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 813/1616] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:27.113710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61757-9578-4f76-b9fa-0ed3c8b4e1fc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.114035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61757-9578-4f76-b9fa-0ed3c8b4e1fc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.114341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61757-9578-4f76-b9fa-0ed3c8b4e1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.147909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-a1a61757-9578-4f76-b9fa-0ed3c8b4e1fc None None] MFA Rules not processed for user `0077a4d1cc544b66abb0ca37ab955c73`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:27.149749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a1a61757-9578-4f76-b9fa-0ed3c8b4e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:27.165824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb66234-b6de-438e-aed8-e8042b83db3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.168990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb66234-b6de-438e-aed8-e8042b83db3e service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:27.183737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 804/1617] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:27.198825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb66234-b6de-438e-aed8-e8042b83db3e service nova] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.221627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb66234-b6de-438e-aed8-e8042b83db3e service nova] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.235740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 814/1618] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:27.236665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a61757-9578-4f76-b9fa-0ed3c8b4e1fc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.251021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1021e7-2190-45ff-89a5-c37feb4c00da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.253188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1021e7-2190-45ff-89a5-c37feb4c00da admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.253581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1021e7-2190-45ff-89a5-c37feb4c00da admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.257306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1021e7-2190-45ff-89a5-c37feb4c00da admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.258003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1021e7-2190-45ff-89a5-c37feb4c00da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.261946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1021e7-2190-45ff-89a5-c37feb4c00da admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:27.264730 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a61757-9578-4f76-b9fa-0ed3c8b4e1fc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.270424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3126d2e-8bb8-4cba-aa4e-adc765be04bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.271239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3126d2e-8bb8-4cba-aa4e-adc765be04bd service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.271618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3126d2e-8bb8-4cba-aa4e-adc765be04bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.272175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3126d2e-8bb8-4cba-aa4e-adc765be04bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.303319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3126d2e-8bb8-4cba-aa4e-adc765be04bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.303565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 805/1619] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:27 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:27.303728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3126d2e-8bb8-4cba-aa4e-adc765be04bd service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:27.303858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1021e7-2190-45ff-89a5-c37feb4c00da admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.314246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1021e7-2190-45ff-89a5-c37feb4c00da admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.322481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0df97-97e0-42f4-a352-a4d4e74553d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.322756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 815/1620] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:27.323573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0df97-97e0-42f4-a352-a4d4e74553d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.324215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0df97-97e0-42f4-a352-a4d4e74553d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.324779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0df97-97e0-42f4-a352-a4d4e74553d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.325681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0df97-97e0-42f4-a352-a4d4e74553d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.329076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0df97-97e0-42f4-a352-a4d4e74553d7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:27.338316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdfaea-ba57-4032-b234-16471feb3ef5 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.338620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdfaea-ba57-4032-b234-16471feb3ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.338955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdfaea-ba57-4032-b234-16471feb3ef5 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.341854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 816/1621] 10.222.0.61 () {54 vars in 961 bytes} [Thu Sep 22 18:25:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:25:27.349342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdfaea-ba57-4032-b234-16471feb3ef5 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.374233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 806/1622] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:27 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:27.375944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a41e3b-1901-49ab-8431-5be9cc95f011 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.376332 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a41e3b-1901-49ab-8431-5be9cc95f011 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.376708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a41e3b-1901-49ab-8431-5be9cc95f011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.388422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdfaea-ba57-4032-b234-16471feb3ef5 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.399460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-25a41e3b-1901-49ab-8431-5be9cc95f011 None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:27.400862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-25a41e3b-1901-49ab-8431-5be9cc95f011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:27.528555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 807/1623] 10.222.0.61 () {58 vars in 1058 bytes} [Thu Sep 22 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:27.529440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a41e3b-1901-49ab-8431-5be9cc95f011 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.539469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af874808-f7b8-4d78-8008-231b576d804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.540166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af874808-f7b8-4d78-8008-231b576d804b admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.540373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af874808-f7b8-4d78-8008-231b576d804b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.540608 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af874808-f7b8-4d78-8008-231b576d804b admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.541285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af874808-f7b8-4d78-8008-231b576d804b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.544101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af874808-f7b8-4d78-8008-231b576d804b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:27.548066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:27.563031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 817/1624] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:27.565301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d74c8-5b55-4a5e-83d7-73dde5a5c32f None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.566086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d74c8-5b55-4a5e-83d7-73dde5a5c32f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.566574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d74c8-5b55-4a5e-83d7-73dde5a5c32f None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.569135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 818/1625] 10.222.0.61 () {54 vars in 912 bytes} [Thu Sep 22 18:25:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:25:27.570281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d74c8-5b55-4a5e-83d7-73dde5a5c32f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.578440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:27.591334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d74c8-5b55-4a5e-83d7-73dde5a5c32f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.602472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815be5ec-0e92-4968-99e4-906017f58d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.603114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815be5ec-0e92-4968-99e4-906017f58d75 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.603670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815be5ec-0e92-4968-99e4-906017f58d75 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.604422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815be5ec-0e92-4968-99e4-906017f58d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.685892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a41e3b-1901-49ab-8431-5be9cc95f011 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.693760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21517b-54d7-49e8-bdda-eee0a6a96e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.694670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21517b-54d7-49e8-bdda-eee0a6a96e72 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.695198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21517b-54d7-49e8-bdda-eee0a6a96e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.695627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21517b-54d7-49e8-bdda-eee0a6a96e72 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.696358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21517b-54d7-49e8-bdda-eee0a6a96e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.699913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21517b-54d7-49e8-bdda-eee0a6a96e72 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:27.735328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 808/1626] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:27 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:27.736389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21517b-54d7-49e8-bdda-eee0a6a96e72 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.748440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21517b-54d7-49e8-bdda-eee0a6a96e72 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.756288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9f310-97d5-4ad1-bcf4-5a374d1a1af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.757516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f310-97d5-4ad1-bcf4-5a374d1a1af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.758234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f310-97d5-4ad1-bcf4-5a374d1a1af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.758759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f310-97d5-4ad1-bcf4-5a374d1a1af3 admin admin] PATH_INFO: `/v3/projects/90bfad88c6d547baaf18c7da739c703b/users/62dc66359c154bea87ed58900c225b3d/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.780882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815be5ec-0e92-4968-99e4-906017f58d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.783905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9f310-97d5-4ad1-bcf4-5a374d1a1af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bfad88c6d547baaf18c7da739c703b, user_id=62dc66359c154bea87ed58900c225b3d, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.784383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815be5ec-0e92-4968-99e4-906017f58d75 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:27.787835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9f310-97d5-4ad1-bcf4-5a374d1a1af3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:27.803964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 819/1627] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:27.805813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e069e1-bd9a-428a-b1d8-501e810706de None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.806308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e069e1-bd9a-428a-b1d8-501e810706de None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.807560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e069e1-bd9a-428a-b1d8-501e810706de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.825252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 809/1628] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:27 2022] PUT /identity/v3/projects/90bfad88c6d547baaf18c7da739c703b/users/62dc66359c154bea87ed58900c225b3d/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:27.828039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9f310-97d5-4ad1-bcf4-5a374d1a1af3 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.839745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-28e069e1-bd9a-428a-b1d8-501e810706de None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:27.841298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-28e069e1-bd9a-428a-b1d8-501e810706de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:27.963166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9f310-97d5-4ad1-bcf4-5a374d1a1af3 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:27.973958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 820/1629] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:27.974850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e069e1-bd9a-428a-b1d8-501e810706de None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:27.975931 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e455049-a0fe-485a-a849-9047e697eb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:27.976570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455049-a0fe-485a-a849-9047e697eb71 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:27.977112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455049-a0fe-485a-a849-9047e697eb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:27.977416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455049-a0fe-485a-a849-9047e697eb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:27.978072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e455049-a0fe-485a-a849-9047e697eb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:27.984225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e455049-a0fe-485a-a849-9047e697eb71 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:28.005001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e069e1-bd9a-428a-b1d8-501e810706de None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:28.013998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 810/1630] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:28.013998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e455049-a0fe-485a-a849-9047e697eb71 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:28.018021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aef4a-661c-4f61-8494-1b020a51bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:28.018715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aef4a-661c-4f61-8494-1b020a51bfdb admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.019002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aef4a-661c-4f61-8494-1b020a51bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.019322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aef4a-661c-4f61-8494-1b020a51bfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.022348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aef4a-661c-4f61-8494-1b020a51bfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:28.023990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aef4a-661c-4f61-8494-1b020a51bfdb admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:28.056989 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 821/1631] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:28.061981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aef4a-661c-4f61-8494-1b020a51bfdb admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:28.080025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aef4a-661c-4f61-8494-1b020a51bfdb admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:28.086603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62791edd-0fff-49cc-86d6-d9dfb4523b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:28.089667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62791edd-0fff-49cc-86d6-d9dfb4523b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.089966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62791edd-0fff-49cc-86d6-d9dfb4523b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.092727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62791edd-0fff-49cc-86d6-d9dfb4523b4a admin admin] PATH_INFO: `/v3/projects/b9f5229ace5e465ba44bb7789a2d2ec2/users/6c41f48de3684c3f83b8bc9cf239264d/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.137127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e455049-a0fe-485a-a849-9047e697eb71 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:28.137512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62791edd-0fff-49cc-86d6-d9dfb4523b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f5229ace5e465ba44bb7789a2d2ec2, user_id=6c41f48de3684c3f83b8bc9cf239264d, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:28.140314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62791edd-0fff-49cc-86d6-d9dfb4523b4a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:28.142011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613042a-8823-4aba-abd6-10c4f43b09db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:28.142812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613042a-8823-4aba-abd6-10c4f43b09db service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.143236 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613042a-8823-4aba-abd6-10c4f43b09db service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.143617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613042a-8823-4aba-abd6-10c4f43b09db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.159519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613042a-8823-4aba-abd6-10c4f43b09db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:28.161649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613042a-8823-4aba-abd6-10c4f43b09db service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:28.167405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 822/1632] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:28 2022] PUT /identity/v3/projects/b9f5229ace5e465ba44bb7789a2d2ec2/users/6c41f48de3684c3f83b8bc9cf239264d/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:28.167405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62791edd-0fff-49cc-86d6-d9dfb4523b4a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:28.179637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 811/1633] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:28.180356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613042a-8823-4aba-abd6-10c4f43b09db service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:28.195525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613042a-8823-4aba-abd6-10c4f43b09db service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:28.252711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:28.265331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:28.280079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62791edd-0fff-49cc-86d6-d9dfb4523b4a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:28.286666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4479c-06b8-43a9-a909-e99d9917fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:28.287463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4479c-06b8-43a9-a909-e99d9917fe74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.287906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4479c-06b8-43a9-a909-e99d9917fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.288249 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4479c-06b8-43a9-a909-e99d9917fe74 admin admin] PATH_INFO: `/v3/projects/90bfad88c6d547baaf18c7da739c703b/users/62dc66359c154bea87ed58900c225b3d/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.291388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4479c-06b8-43a9-a909-e99d9917fe74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bfad88c6d547baaf18c7da739c703b, user_id=62dc66359c154bea87ed58900c225b3d, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:28.295526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4479c-06b8-43a9-a909-e99d9917fe74 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:28.320864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 823/1634] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:28 2022] PUT /identity/v3/projects/90bfad88c6d547baaf18c7da739c703b/users/62dc66359c154bea87ed58900c225b3d/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:28.322454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca418d3c-cd91-4f76-b6c8-d67aaeb71c21 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.322748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca418d3c-cd91-4f76-b6c8-d67aaeb71c21 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.323031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca418d3c-cd91-4f76-b6c8-d67aaeb71c21 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.324671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 824/1635] 10.222.0.61 () {54 vars in 912 bytes} [Thu Sep 22 18:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:25:28.325777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b768-3fbd-45b2-abb0-2ca05672e8df None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.326067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b768-3fbd-45b2-abb0-2ca05672e8df None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.326346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b768-3fbd-45b2-abb0-2ca05672e8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.364331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a9a89-88fc-4982-8dbe-e9ec32eae0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:28.364973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a9a89-88fc-4982-8dbe-e9ec32eae0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.365265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a9a89-88fc-4982-8dbe-e9ec32eae0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.368095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f2f4b768-3fbd-45b2-abb0-2ca05672e8df None None] MFA Rules not processed for user `62dc66359c154bea87ed58900c225b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:28.368693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a9a89-88fc-4982-8dbe-e9ec32eae0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.369385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f2f4b768-3fbd-45b2-abb0-2ca05672e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:28.369526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a9a89-88fc-4982-8dbe-e9ec32eae0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:28.372900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a9a89-88fc-4982-8dbe-e9ec32eae0a4 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:28.398683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 812/1636] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:28.401541 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af27de-6b02-4fcf-b3da-d8a15764fe3c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.403616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af27de-6b02-4fcf-b3da-d8a15764fe3c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.403760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af27de-6b02-4fcf-b3da-d8a15764fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.447967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a3af27de-6b02-4fcf-b3da-d8a15764fe3c None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:28.451714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a3af27de-6b02-4fcf-b3da-d8a15764fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:28.482191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 825/1637] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:28.484724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b768-3fbd-45b2-abb0-2ca05672e8df None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:28.600213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 813/1638] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:25:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:28.602375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af27de-6b02-4fcf-b3da-d8a15764fe3c None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:28.651459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b768-3fbd-45b2-abb0-2ca05672e8df None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:28.667482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2f408-5a3b-43d7-ba72-27c005c39d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:28.668213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f408-5a3b-43d7-ba72-27c005c39d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.668469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f408-5a3b-43d7-ba72-27c005c39d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.668799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f408-5a3b-43d7-ba72-27c005c39d09 admin admin] PATH_INFO: `/v3/projects/b9f5229ace5e465ba44bb7789a2d2ec2/users/6c41f48de3684c3f83b8bc9cf239264d/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.678773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2f408-5a3b-43d7-ba72-27c005c39d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f5229ace5e465ba44bb7789a2d2ec2, user_id=6c41f48de3684c3f83b8bc9cf239264d, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:28.684276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2f408-5a3b-43d7-ba72-27c005c39d09 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:28.698422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af27de-6b02-4fcf-b3da-d8a15764fe3c None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:28.711533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 826/1639] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:28 2022] PUT /identity/v3/projects/b9f5229ace5e465ba44bb7789a2d2ec2/users/6c41f48de3684c3f83b8bc9cf239264d/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:28.713469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cddbef-fe6d-4e33-879c-a39cbde935ea None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.713469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cddbef-fe6d-4e33-879c-a39cbde935ea None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.715854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cddbef-fe6d-4e33-879c-a39cbde935ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.755239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-02cddbef-fe6d-4e33-879c-a39cbde935ea None None] MFA Rules not processed for user `6c41f48de3684c3f83b8bc9cf239264d`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:28.757516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-02cddbef-fe6d-4e33-879c-a39cbde935ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:28.781088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff55087-cbb4-4f58-976f-8a1cdb832c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:28.782273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff55087-cbb4-4f58-976f-8a1cdb832c0c service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.782924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff55087-cbb4-4f58-976f-8a1cdb832c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.783564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff55087-cbb4-4f58-976f-8a1cdb832c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.812298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:28.840929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:28.867345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff55087-cbb4-4f58-976f-8a1cdb832c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:28.869203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff55087-cbb4-4f58-976f-8a1cdb832c0c service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:28.876339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 827/1640] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:28.888073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 814/1641] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:28.908952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cddbef-fe6d-4e33-879c-a39cbde935ea None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:28.919793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cddbef-fe6d-4e33-879c-a39cbde935ea None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:28.924704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a99-d797-426c-af78-d289ecd7be57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:28.925970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a99-d797-426c-af78-d289ecd7be57 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.926240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a99-d797-426c-af78-d289ecd7be57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.926828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a99-d797-426c-af78-d289ecd7be57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:28.974918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff55087-cbb4-4f58-976f-8a1cdb832c0c service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:28.991378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff55087-cbb4-4f58-976f-8a1cdb832c0c service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:28.996638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf2b3-78a7-4d0f-8f9e-d4f8833d189e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:28.996990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf2b3-78a7-4d0f-8f9e-d4f8833d189e service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:28.997478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf2b3-78a7-4d0f-8f9e-d4f8833d189e service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:28.997771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf2b3-78a7-4d0f-8f9e-d4f8833d189e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:29.013588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf2b3-78a7-4d0f-8f9e-d4f8833d189e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:29.015693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3baf2b3-78a7-4d0f-8f9e-d4f8833d189e service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:29.030617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 815/1642] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:25:29.055968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad23a99-d797-426c-af78-d289ecd7be57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:29.058018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad23a99-d797-426c-af78-d289ecd7be57 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:29.087405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 828/1643] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:29.393099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf2b3-78a7-4d0f-8f9e-d4f8833d189e service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:29.405357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf2b3-78a7-4d0f-8f9e-d4f8833d189e service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:29.412813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75532e9f-1881-4218-8c8e-c644044eeb54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:29.413164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75532e9f-1881-4218-8c8e-c644044eeb54 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:29.413422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75532e9f-1881-4218-8c8e-c644044eeb54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:29.413638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75532e9f-1881-4218-8c8e-c644044eeb54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:29.457494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a99-d797-426c-af78-d289ecd7be57 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:29.472463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a99-d797-426c-af78-d289ecd7be57 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:29.482729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452275b-8b4c-4846-bb63-6fb73b5d35a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:29.486104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452275b-8b4c-4846-bb63-6fb73b5d35a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:29.486542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452275b-8b4c-4846-bb63-6fb73b5d35a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:29.487692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452275b-8b4c-4846-bb63-6fb73b5d35a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:29.571227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75532e9f-1881-4218-8c8e-c644044eeb54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:29.573674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75532e9f-1881-4218-8c8e-c644044eeb54 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:29.603252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 816/1644] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:29.717825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452275b-8b4c-4846-bb63-6fb73b5d35a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:29.717825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452275b-8b4c-4846-bb63-6fb73b5d35a7 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:29.761432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 829/1645] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:25:32.209635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75532e9f-1881-4218-8c8e-c644044eeb54 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:32.344306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75532e9f-1881-4218-8c8e-c644044eeb54 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:32.358348 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:32.359172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:32.359562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:32.359944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] PATH_INFO: `/v3/users/1b499b317e884632a0a1f69959752e9d` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:32.362357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b499b317e884632a0a1f69959752e9d)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:32.365000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:32.498398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:32.501014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b499b317e884632a0a1f69959752e9d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:32.517986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b499b317e884632a0a1f69959752e9d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:32.518701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b499b317e884632a0a1f69959752e9d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:32.538398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b499b317e884632a0a1f69959752e9d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:32.547898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b499b317e884632a0a1f69959752e9d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:32.557814 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 817/1646] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:25:32 2022] DELETE /identity/v3/users/1b499b317e884632a0a1f69959752e9d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:25:32.562200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efed457-5bbd-461d-a0c0-3a29ca37e364 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:32.563136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efed457-5bbd-461d-a0c0-3a29ca37e364 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:32.563852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efed457-5bbd-461d-a0c0-3a29ca37e364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:32.586446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4efed457-5bbd-461d-a0c0-3a29ca37e364 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:32.588082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4efed457-5bbd-461d-a0c0-3a29ca37e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:32.670814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 830/1647] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:32.697920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:32.698685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:32.830109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f145-c7d5-4c64-9731-7dc9d074421e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:32.864239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766c904-98e8-41fb-a84e-56f5c5c53fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:32.865383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c904-98e8-41fb-a84e-56f5c5c53fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:32.867560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c904-98e8-41fb-a84e-56f5c5c53fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:32.867766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c904-98e8-41fb-a84e-56f5c5c53fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:32.900751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766c904-98e8-41fb-a84e-56f5c5c53fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:32.907724 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766c904-98e8-41fb-a84e-56f5c5c53fd1 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:32.937797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 818/1648] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:25:34.350783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efed457-5bbd-461d-a0c0-3a29ca37e364 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:34.360337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4efed457-5bbd-461d-a0c0-3a29ca37e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:34.384128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efed457-5bbd-461d-a0c0-3a29ca37e364 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:34.400627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:34.401321 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:34.404405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:34.404707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] PATH_INFO: `/v3/projects/7627f15ced54400181858ae982f71d7c` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:34.406838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7627f15ced54400181858ae982f71d7c)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:34.409185 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:34.431474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:34.538840 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7627f15ced54400181858ae982f71d7c', 'request_id': 'req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:34.553955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7627f15ced54400181858ae982f71d7c', 'request_id': 'req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:34.562635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7627f15ced54400181858ae982f71d7c', 'request_id': 'req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:34.579367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] The token cache is being invalidate because project 7627f15ced54400181858ae982f71d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:25:34.579969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:34.580894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0b0bf35f-a9fd-4aa3-afc2-78a3ae55f910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:34.583324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 831/1649] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:25:34 2022] DELETE /identity/v3/projects/7627f15ced54400181858ae982f71d7c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:34.587995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c7702-03b9-4bfb-8f27-eaa075db6e88 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:34.588512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c7702-03b9-4bfb-8f27-eaa075db6e88 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:34.588598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c7702-03b9-4bfb-8f27-eaa075db6e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:34.612567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-456c7702-03b9-4bfb-8f27-eaa075db6e88 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:34.614455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-456c7702-03b9-4bfb-8f27-eaa075db6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:34.769560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 819/1650] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:34.772053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf41298-719e-47e9-9283-da802d1425ae None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:34.772440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf41298-719e-47e9-9283-da802d1425ae None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:34.772886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf41298-719e-47e9-9283-da802d1425ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:34.816562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-bdf41298-719e-47e9-9283-da802d1425ae None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:34.818707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bdf41298-719e-47e9-9283-da802d1425ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:34.841115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 832/1651] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:34.846022 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c7702-03b9-4bfb-8f27-eaa075db6e88 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:34.860367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c7702-03b9-4bfb-8f27-eaa075db6e88 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:34.873828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8723ae-f8d1-4fc5-b2e2-c9d0f5449894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:34.874762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8723ae-f8d1-4fc5-b2e2-c9d0f5449894 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:34.875202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8723ae-f8d1-4fc5-b2e2-c9d0f5449894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:34.876173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8723ae-f8d1-4fc5-b2e2-c9d0f5449894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:34.876829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8723ae-f8d1-4fc5-b2e2-c9d0f5449894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:34.876829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8723ae-f8d1-4fc5-b2e2-c9d0f5449894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:34.881613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8723ae-f8d1-4fc5-b2e2-c9d0f5449894 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:34.917682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 820/1652] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:34.919278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf41298-719e-47e9-9283-da802d1425ae None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:34.935301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf41298-719e-47e9-9283-da802d1425ae None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:34.950426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfeaef-b5fa-4494-aeaf-ab2675888183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:34.951283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfeaef-b5fa-4494-aeaf-ab2675888183 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:34.951661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfeaef-b5fa-4494-aeaf-ab2675888183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:34.952162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfeaef-b5fa-4494-aeaf-ab2675888183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:34.952855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfeaef-b5fa-4494-aeaf-ab2675888183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:34.954917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfeaef-b5fa-4494-aeaf-ab2675888183 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:35.020941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 833/1653] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:34 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:35.024817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8723ae-f8d1-4fc5-b2e2-c9d0f5449894 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:35.039241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8723ae-f8d1-4fc5-b2e2-c9d0f5449894 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:35.124195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75565fd7-f575-4951-89fc-07e0095e5339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:35.124835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75565fd7-f575-4951-89fc-07e0095e5339 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:35.125148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75565fd7-f575-4951-89fc-07e0095e5339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:35.125821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75565fd7-f575-4951-89fc-07e0095e5339 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:35.126496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75565fd7-f575-4951-89fc-07e0095e5339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:35.132002 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:35.132562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75565fd7-f575-4951-89fc-07e0095e5339 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:35.183388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 821/1654] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:35 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:35.187082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfeaef-b5fa-4494-aeaf-ab2675888183 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:35.213590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfeaef-b5fa-4494-aeaf-ab2675888183 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:35.227559 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e3ec-b64b-4511-b38a-075654e2c888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:35.228205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e3ec-b64b-4511-b38a-075654e2c888 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:35.228489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e3ec-b64b-4511-b38a-075654e2c888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:35.228766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e3ec-b64b-4511-b38a-075654e2c888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:35.229468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2e3ec-b64b-4511-b38a-075654e2c888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:35.231098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2e3ec-b64b-4511-b38a-075654e2c888 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:35.266123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75565fd7-f575-4951-89fc-07e0095e5339 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:35.273364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 834/1655] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:35.289602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75565fd7-f575-4951-89fc-07e0095e5339 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:35.324214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed235a-8812-4a9c-89f3-1d9ff8f1a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:35.324729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed235a-8812-4a9c-89f3-1d9ff8f1a0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:35.325016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed235a-8812-4a9c-89f3-1d9ff8f1a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:35.325320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed235a-8812-4a9c-89f3-1d9ff8f1a0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:35.325980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed235a-8812-4a9c-89f3-1d9ff8f1a0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:35.327917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed235a-8812-4a9c-89f3-1d9ff8f1a0a7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:35.357205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 822/1656] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:25:35.360947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e3ec-b64b-4511-b38a-075654e2c888 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:35.382475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed235a-8812-4a9c-89f3-1d9ff8f1a0a7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:35.386461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-04ed235a-8812-4a9c-89f3-1d9ff8f1a0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:35.404034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e3ec-b64b-4511-b38a-075654e2c888 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:35.432916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53493c62-7059-4590-8ff0-5577dd040319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:35.435034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53493c62-7059-4590-8ff0-5577dd040319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:35.435495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53493c62-7059-4590-8ff0-5577dd040319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:35.436055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53493c62-7059-4590-8ff0-5577dd040319 admin admin] PATH_INFO: `/v3/projects/99ab46ec0e7640a0977f73cd71e976d2/users/38a162ed17854d538822533a5c1d6bda/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:35.440784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed235a-8812-4a9c-89f3-1d9ff8f1a0a7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:35.452429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:35.452948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:35.453317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:35.453534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] PATH_INFO: `/v3/users/0077a4d1cc544b66abb0ca37ab955c73` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:35.458389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0077a4d1cc544b66abb0ca37ab955c73)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:35.462571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:35.495691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53493c62-7059-4590-8ff0-5577dd040319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ab46ec0e7640a0977f73cd71e976d2, user_id=38a162ed17854d538822533a5c1d6bda, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:35.500299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53493c62-7059-4590-8ff0-5577dd040319 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:35.542430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 835/1657] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:35 2022] PUT /identity/v3/projects/99ab46ec0e7640a0977f73cd71e976d2/users/38a162ed17854d538822533a5c1d6bda/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:35.554459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed794-47d8-46c1-88bd-bd7e6d54be55 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:35.555249 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed794-47d8-46c1-88bd-bd7e6d54be55 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:35.555938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed794-47d8-46c1-88bd-bd7e6d54be55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:35.604001 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0077a4d1cc544b66abb0ca37ab955c73'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:35.619003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0077a4d1cc544b66abb0ca37ab955c73'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:35.620645 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0077a4d1cc544b66abb0ca37ab955c73'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:35.666681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b91ed794-47d8-46c1-88bd-bd7e6d54be55 None None] MFA Rules not processed for user `38a162ed17854d538822533a5c1d6bda`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:35.669265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b91ed794-47d8-46c1-88bd-bd7e6d54be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:35.673556 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0077a4d1cc544b66abb0ca37ab955c73'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:35.690723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d7cffb3-7e61-4ec5-b982-b3bce7818593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0077a4d1cc544b66abb0ca37ab955c73'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:35.706556 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 823/1658] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:25:35 2022] DELETE /identity/v3/users/0077a4d1cc544b66abb0ca37ab955c73 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:35.713854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49e81-20ce-419e-89c0-dee0bccfc7ed None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:35.714668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49e81-20ce-419e-89c0-dee0bccfc7ed None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:35.715219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49e81-20ce-419e-89c0-dee0bccfc7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:35.757800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d9e49e81-20ce-419e-89c0-dee0bccfc7ed None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:35.759274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d9e49e81-20ce-419e-89c0-dee0bccfc7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:35.893836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 836/1659] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:25:35.912029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed794-47d8-46c1-88bd-bd7e6d54be55 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:35.913840 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b91ed794-47d8-46c1-88bd-bd7e6d54be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:35.975305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 824/1660] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:35.990428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:36.120100 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed794-47d8-46c1-88bd-bd7e6d54be55 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:36.237663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49e81-20ce-419e-89c0-dee0bccfc7ed None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:36.241169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d9e49e81-20ce-419e-89c0-dee0bccfc7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:36.343567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109ec92-8933-4039-b5c0-c7c5a8e959f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:36.344023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109ec92-8933-4039-b5c0-c7c5a8e959f2 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:36.344320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109ec92-8933-4039-b5c0-c7c5a8e959f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:36.347772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109ec92-8933-4039-b5c0-c7c5a8e959f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:36.451117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:36.508719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49e81-20ce-419e-89c0-dee0bccfc7ed None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:36.523621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109ec92-8933-4039-b5c0-c7c5a8e959f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:36.527229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62409973-79be-4f59-bbe1-9271f954bc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:36.530269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62409973-79be-4f59-bbe1-9271f954bc5f service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:36.530386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109ec92-8933-4039-b5c0-c7c5a8e959f2 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:36.530550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62409973-79be-4f59-bbe1-9271f954bc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:36.530832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62409973-79be-4f59-bbe1-9271f954bc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:36.557469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 837/1661] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:36.575424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62409973-79be-4f59-bbe1-9271f954bc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:36.579762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62409973-79be-4f59-bbe1-9271f954bc5f service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:36.626468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 825/1662] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:25:36.879270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109ec92-8933-4039-b5c0-c7c5a8e959f2 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:36.882763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a109ec92-8933-4039-b5c0-c7c5a8e959f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:36.939431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109ec92-8933-4039-b5c0-c7c5a8e959f2 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:36.962733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:36.965923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:36.966219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:36.967699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] PATH_INFO: `/v3/users/38a162ed17854d538822533a5c1d6bda` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:36.977732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a162ed17854d538822533a5c1d6bda)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:36.978798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: WARNING py.warnings [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:25:36.978798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: warnings.warn(msg) Sep 22 18:25:36.978798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: Sep 22 18:25:36.982973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:37.197549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a162ed17854d538822533a5c1d6bda'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:37.198411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d30ba-0cae-4172-b7c4-c5b486fc98a2 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:37.198795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d30ba-0cae-4172-b7c4-c5b486fc98a2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:37.199140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d30ba-0cae-4172-b7c4-c5b486fc98a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:37.208530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:37.220180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a162ed17854d538822533a5c1d6bda'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:37.221941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a162ed17854d538822533a5c1d6bda'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:37.259732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2a8d30ba-0cae-4172-b7c4-c5b486fc98a2 None None] MFA Rules not processed for user `c334003dcc634b4c86ba14c542fb60aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:37.261146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2a8d30ba-0cae-4172-b7c4-c5b486fc98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:37.284003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a162ed17854d538822533a5c1d6bda'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:37.302485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bde83119-02be-4b00-946b-f204796be0ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a162ed17854d538822533a5c1d6bda'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:37.311306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 838/1663] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:25:36 2022] DELETE /identity/v3/users/38a162ed17854d538822533a5c1d6bda => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:37.317198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fce15-63de-41fb-b771-34316d2b7304 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:37.320108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fce15-63de-41fb-b771-34316d2b7304 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:37.320497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fce15-63de-41fb-b771-34316d2b7304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:37.382836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-039fce15-63de-41fb-b771-34316d2b7304 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:37.390036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-039fce15-63de-41fb-b771-34316d2b7304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:37.424048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 826/1664] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:37.440281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d30ba-0cae-4172-b7c4-c5b486fc98a2 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:37.441854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2a8d30ba-0cae-4172-b7c4-c5b486fc98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:37.484360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d30ba-0cae-4172-b7c4-c5b486fc98a2 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:37.535429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 839/1665] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:37.547949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fce15-63de-41fb-b771-34316d2b7304 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:37.549756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-039fce15-63de-41fb-b771-34316d2b7304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:37.681117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fde8d7-30a9-4499-ba45-8c77a9ac4983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:37.681799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fde8d7-30a9-4499-ba45-8c77a9ac4983 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:37.682068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fde8d7-30a9-4499-ba45-8c77a9ac4983 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:37.682347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fde8d7-30a9-4499-ba45-8c77a9ac4983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:37.727978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fce15-63de-41fb-b771-34316d2b7304 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:37.736954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d24ef3-8ee7-428f-bd8e-159fb20285f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:37.737875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d24ef3-8ee7-428f-bd8e-159fb20285f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:37.738316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d24ef3-8ee7-428f-bd8e-159fb20285f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:37.738745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d24ef3-8ee7-428f-bd8e-159fb20285f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:37.758279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d24ef3-8ee7-428f-bd8e-159fb20285f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:37.760792 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d24ef3-8ee7-428f-bd8e-159fb20285f6 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:37.788412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 840/1666] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:25:37.789460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d24ef3-8ee7-428f-bd8e-159fb20285f6 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:37.797010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-09d24ef3-8ee7-428f-bd8e-159fb20285f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:37.799858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fde8d7-30a9-4499-ba45-8c77a9ac4983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:37.802572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fde8d7-30a9-4499-ba45-8c77a9ac4983 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:37.818719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 827/1667] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:25:37.821216 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d24ef3-8ee7-428f-bd8e-159fb20285f6 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:37.839051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:37.839997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:37.840626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:37.841059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] PATH_INFO: `/v3/projects/510e189fb50e4e2f9c91ad44416c095b` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:37.842871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510e189fb50e4e2f9c91ad44416c095b)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:37.845152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:37.957747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510e189fb50e4e2f9c91ad44416c095b', 'request_id': 'req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:37.968384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510e189fb50e4e2f9c91ad44416c095b', 'request_id': 'req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:37.976589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510e189fb50e4e2f9c91ad44416c095b', 'request_id': 'req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:37.980157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:37.998176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] The token cache is being invalidate because project 510e189fb50e4e2f9c91ad44416c095b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:25:37.998957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:38.000362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-03ddd9a7-7e1d-4aa8-b185-0217d57531e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:38.002850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 841/1668] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:25:37 2022] DELETE /identity/v3/projects/510e189fb50e4e2f9c91ad44416c095b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:38.008714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa9cd-426f-4084-9838-0203c17a2735 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:38.008915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa9cd-426f-4084-9838-0203c17a2735 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:38.009186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa9cd-426f-4084-9838-0203c17a2735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:38.046855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ba4fa9cd-426f-4084-9838-0203c17a2735 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:38.051747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ba4fa9cd-426f-4084-9838-0203c17a2735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:38.068325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:38.199073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 828/1669] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:38.206266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268bba-9f54-4107-9973-36f7bc77fb68 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:38.206618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268bba-9f54-4107-9973-36f7bc77fb68 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:38.206982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268bba-9f54-4107-9973-36f7bc77fb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:38.246518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f3268bba-9f54-4107-9973-36f7bc77fb68 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:38.247850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f3268bba-9f54-4107-9973-36f7bc77fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:38.272837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 842/1670] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:38.277189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa9cd-426f-4084-9838-0203c17a2735 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:38.298512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa9cd-426f-4084-9838-0203c17a2735 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:38.317538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d54b93-ce6a-480a-9539-8f8d8c6b64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:38.318227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d54b93-ce6a-480a-9539-8f8d8c6b64d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:38.318515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d54b93-ce6a-480a-9539-8f8d8c6b64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:38.318796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d54b93-ce6a-480a-9539-8f8d8c6b64d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:38.319469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d54b93-ce6a-480a-9539-8f8d8c6b64d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:38.322887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d54b93-ce6a-480a-9539-8f8d8c6b64d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:38.326635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d54b93-ce6a-480a-9539-8f8d8c6b64d3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:38.361519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 829/1671] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:38.366366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3268bba-9f54-4107-9973-36f7bc77fb68 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:38.378900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3268bba-9f54-4107-9973-36f7bc77fb68 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:38.385674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da4369-f12e-470d-bd5b-3c91100006db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:38.386682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da4369-f12e-470d-bd5b-3c91100006db admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:38.387277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da4369-f12e-470d-bd5b-3c91100006db admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:38.387716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da4369-f12e-470d-bd5b-3c91100006db admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:38.388618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da4369-f12e-470d-bd5b-3c91100006db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:38.392626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da4369-f12e-470d-bd5b-3c91100006db admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:38.444285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 843/1672] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:38 2022] POST /identity/v3/projects => generated 403 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:38.447720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d54b93-ce6a-480a-9539-8f8d8c6b64d3 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:38.464114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d54b93-ce6a-480a-9539-8f8d8c6b64d3 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:38.693883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9605-82d5-41ac-bfa1-1f11f2ba8a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:38.695703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9605-82d5-41ac-bfa1-1f11f2ba8a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:38.698025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9605-82d5-41ac-bfa1-1f11f2ba8a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:38.698439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9605-82d5-41ac-bfa1-1f11f2ba8a35 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:38.699354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9605-82d5-41ac-bfa1-1f11f2ba8a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:38.708199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9605-82d5-41ac-bfa1-1f11f2ba8a35 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:38.757604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 830/1673] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:38 2022] POST /identity/v3/users => generated 302 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:38.761885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da4369-f12e-470d-bd5b-3c91100006db admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:38.781665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da4369-f12e-470d-bd5b-3c91100006db admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:38.799869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab19042-e2d8-43e0-9b0d-f5bb90027d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:38.800969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab19042-e2d8-43e0-9b0d-f5bb90027d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:38.801565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab19042-e2d8-43e0-9b0d-f5bb90027d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:38.802032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab19042-e2d8-43e0-9b0d-f5bb90027d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:38.803869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab19042-e2d8-43e0-9b0d-f5bb90027d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:38.808342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab19042-e2d8-43e0-9b0d-f5bb90027d5d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:38.838134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 844/1674] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:38.850799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9605-82d5-41ac-bfa1-1f11f2ba8a35 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:38.866108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9605-82d5-41ac-bfa1-1f11f2ba8a35 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:38.880650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a06979-473a-451b-a768-6275b16d58dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:38.881309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a06979-473a-451b-a768-6275b16d58dd admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:38.881599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a06979-473a-451b-a768-6275b16d58dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:38.881884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a06979-473a-451b-a768-6275b16d58dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:38.882569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a06979-473a-451b-a768-6275b16d58dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:38.895228 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a06979-473a-451b-a768-6275b16d58dd admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:38.924208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 831/1675] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:38.929011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab19042-e2d8-43e0-9b0d-f5bb90027d5d admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:38.943049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab19042-e2d8-43e0-9b0d-f5bb90027d5d admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:38.964304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3c122-9007-441c-9d9e-2fa38c1d667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:38.965023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3c122-9007-441c-9d9e-2fa38c1d667b admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:38.965344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3c122-9007-441c-9d9e-2fa38c1d667b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:38.965628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3c122-9007-441c-9d9e-2fa38c1d667b admin admin] PATH_INFO: `/v3/projects/498df6f50ae94707a05b409862d19936/users/7bfbf57be6fd4ef3b7ea3f6b7519e414/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:39.012188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3c122-9007-441c-9d9e-2fa38c1d667b admin admin] RBAC: Authorizing `identity:create_grant(project_id=498df6f50ae94707a05b409862d19936, user_id=7bfbf57be6fd4ef3b7ea3f6b7519e414, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:39.024709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3c122-9007-441c-9d9e-2fa38c1d667b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:39.064343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 845/1676] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:38 2022] PUT /identity/v3/projects/498df6f50ae94707a05b409862d19936/users/7bfbf57be6fd4ef3b7ea3f6b7519e414/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:39.067062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032adc4-6987-4777-8645-22e58373f4c9 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:39.067563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032adc4-6987-4777-8645-22e58373f4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:39.068052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032adc4-6987-4777-8645-22e58373f4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:39.115506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2032adc4-6987-4777-8645-22e58373f4c9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:39.119018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2032adc4-6987-4777-8645-22e58373f4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:39.324143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 832/1677] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:39.335554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3c122-9007-441c-9d9e-2fa38c1d667b admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:39.339092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-49a3c122-9007-441c-9d9e-2fa38c1d667b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:39.430495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032adc4-6987-4777-8645-22e58373f4c9 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:39.433089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2032adc4-6987-4777-8645-22e58373f4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:39.463119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3c122-9007-441c-9d9e-2fa38c1d667b admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:39.476513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f55e6d-086d-4ccf-a63c-a3b26b382193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:39.478358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f55e6d-086d-4ccf-a63c-a3b26b382193 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:39.478985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f55e6d-086d-4ccf-a63c-a3b26b382193 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:39.479627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f55e6d-086d-4ccf-a63c-a3b26b382193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:39.487609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032adc4-6987-4777-8645-22e58373f4c9 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:39.498690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f55e6d-086d-4ccf-a63c-a3b26b382193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:39.501355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f55e6d-086d-4ccf-a63c-a3b26b382193 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:39.510186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:39.514066 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:39.514178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:39.515867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] PATH_INFO: `/v3/projects/99ab46ec0e7640a0977f73cd71e976d2` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:39.517579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ab46ec0e7640a0977f73cd71e976d2)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:39.540499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 846/1678] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:39.541793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: WARNING py.warnings [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 18:25:39.541793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: warnings.warn(msg) Sep 22 18:25:39.541793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: Sep 22 18:25:39.543838 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:39.629592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:39.773181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ab46ec0e7640a0977f73cd71e976d2', 'request_id': 'req-97bbb7a1-5d21-4751-97a6-d17f39c16f53'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:39.813223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ab46ec0e7640a0977f73cd71e976d2', 'request_id': 'req-97bbb7a1-5d21-4751-97a6-d17f39c16f53'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:39.831605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ab46ec0e7640a0977f73cd71e976d2', 'request_id': 'req-97bbb7a1-5d21-4751-97a6-d17f39c16f53'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:39.854286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] The token cache is being invalidate because project 99ab46ec0e7640a0977f73cd71e976d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:25:39.854809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:39.867966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-97bbb7a1-5d21-4751-97a6-d17f39c16f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:39.879264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 833/1679] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:25:39 2022] DELETE /identity/v3/projects/99ab46ec0e7640a0977f73cd71e976d2 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:39.881458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc38e9e-9c09-4363-97b7-1f1509702ca5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:39.882294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc38e9e-9c09-4363-97b7-1f1509702ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:39.882595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc38e9e-9c09-4363-97b7-1f1509702ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:39.916126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-ebc38e9e-9c09-4363-97b7-1f1509702ca5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:39.917525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ebc38e9e-9c09-4363-97b7-1f1509702ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:40.035674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c22ca4-ef51-44e1-9830-bac0e2845e18 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:40.035971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c22ca4-ef51-44e1-9830-bac0e2845e18 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:40.036458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c22ca4-ef51-44e1-9830-bac0e2845e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:40.045551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 847/1680] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:40.067071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-20c22ca4-ef51-44e1-9830-bac0e2845e18 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:40.068621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-20c22ca4-ef51-44e1-9830-bac0e2845e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:40.086370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc38e9e-9c09-4363-97b7-1f1509702ca5 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:40.093789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 834/1681] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:40.100511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc38e9e-9c09-4363-97b7-1f1509702ca5 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:40.108148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88dd1-ffd8-472b-9ace-7949d0b761fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:40.108862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88dd1-ffd8-472b-9ace-7949d0b761fd admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:40.109161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88dd1-ffd8-472b-9ace-7949d0b761fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:40.109544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88dd1-ffd8-472b-9ace-7949d0b761fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:40.110465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88dd1-ffd8-472b-9ace-7949d0b761fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:40.110783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88dd1-ffd8-472b-9ace-7949d0b761fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:40.112653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88dd1-ffd8-472b-9ace-7949d0b761fd admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:40.132298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 848/1682] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:25:40.132639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c22ca4-ef51-44e1-9830-bac0e2845e18 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:40.144933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c22ca4-ef51-44e1-9830-bac0e2845e18 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:40.156398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990e492-11da-45b9-a572-b6de09ac752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:40.157058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990e492-11da-45b9-a572-b6de09ac752b admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:40.159501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990e492-11da-45b9-a572-b6de09ac752b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:40.159877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990e492-11da-45b9-a572-b6de09ac752b admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:40.160577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990e492-11da-45b9-a572-b6de09ac752b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:40.162582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990e492-11da-45b9-a572-b6de09ac752b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:40.251744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88dd1-ffd8-472b-9ace-7949d0b761fd admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:40.253445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 835/1683] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:40 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:40.267342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88dd1-ffd8-472b-9ace-7949d0b761fd admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:40.313865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:40.438509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058b2ef-d704-4b91-861a-6f0ea9c5e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:40.439151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058b2ef-d704-4b91-861a-6f0ea9c5e6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:40.439604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058b2ef-d704-4b91-861a-6f0ea9c5e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:40.440019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058b2ef-d704-4b91-861a-6f0ea9c5e6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:40.443894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058b2ef-d704-4b91-861a-6f0ea9c5e6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:40.453529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058b2ef-d704-4b91-861a-6f0ea9c5e6f1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:40.527557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 849/1684] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:40 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:40.531927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990e492-11da-45b9-a572-b6de09ac752b admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:40.552098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990e492-11da-45b9-a572-b6de09ac752b admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:40.559548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43905e-1784-463c-9a66-3ecc2842492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:40.560913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43905e-1784-463c-9a66-3ecc2842492b admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:40.561793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43905e-1784-463c-9a66-3ecc2842492b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:40.562123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43905e-1784-463c-9a66-3ecc2842492b admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:40.562803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43905e-1784-463c-9a66-3ecc2842492b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:40.564638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43905e-1784-463c-9a66-3ecc2842492b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:40.597902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 836/1685] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:40.600114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058b2ef-d704-4b91-861a-6f0ea9c5e6f1 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:40.625513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058b2ef-d704-4b91-861a-6f0ea9c5e6f1 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:40.640050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb8f6-ef54-4ed3-859e-4325a841bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:40.640816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb8f6-ef54-4ed3-859e-4325a841bc8f admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:40.641183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb8f6-ef54-4ed3-859e-4325a841bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:40.641542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb8f6-ef54-4ed3-859e-4325a841bc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:40.642283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb8f6-ef54-4ed3-859e-4325a841bc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:40.647223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb8f6-ef54-4ed3-859e-4325a841bc8f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:40.693759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 850/1686] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:40.698243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43905e-1784-463c-9a66-3ecc2842492b admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:40.714653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43905e-1784-463c-9a66-3ecc2842492b admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:40.730437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61736f5-4b89-45e8-be7b-aefa33c66a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:40.731171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61736f5-4b89-45e8-be7b-aefa33c66a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:40.731574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61736f5-4b89-45e8-be7b-aefa33c66a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:40.731868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61736f5-4b89-45e8-be7b-aefa33c66a7f admin admin] PATH_INFO: `/v3/projects/a4f9d6bda9e94e9d9411b2650b43db79/users/9cfad8a814a9432895d9db9925a23542/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:40.762333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61736f5-4b89-45e8-be7b-aefa33c66a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f9d6bda9e94e9d9411b2650b43db79, user_id=9cfad8a814a9432895d9db9925a23542, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:40.767720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61736f5-4b89-45e8-be7b-aefa33c66a7f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:40.795977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 837/1687] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:40 2022] PUT /identity/v3/projects/a4f9d6bda9e94e9d9411b2650b43db79/users/9cfad8a814a9432895d9db9925a23542/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:25:40.806750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f7e0d-c21c-4ea3-9fa2-cc72baa9414e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:40.807385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f7e0d-c21c-4ea3-9fa2-cc72baa9414e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:40.807855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f7e0d-c21c-4ea3-9fa2-cc72baa9414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:40.887634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-e30f7e0d-c21c-4ea3-9fa2-cc72baa9414e None None] MFA Rules not processed for user `9cfad8a814a9432895d9db9925a23542`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:40.891874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e30f7e0d-c21c-4ea3-9fa2-cc72baa9414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:41.071029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 851/1688] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:41.073492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61736f5-4b89-45e8-be7b-aefa33c66a7f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:41.227460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61736f5-4b89-45e8-be7b-aefa33c66a7f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:41.240380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa413c-91db-4b2b-a7e0-431327c1615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:41.241222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa413c-91db-4b2b-a7e0-431327c1615a admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:41.241535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa413c-91db-4b2b-a7e0-431327c1615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:41.241815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa413c-91db-4b2b-a7e0-431327c1615a admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:41.242602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa413c-91db-4b2b-a7e0-431327c1615a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:41.245416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa413c-91db-4b2b-a7e0-431327c1615a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:41.319711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 838/1689] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:41 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:41.320420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f7e0d-c21c-4ea3-9fa2-cc72baa9414e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:41.345006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f7e0d-c21c-4ea3-9fa2-cc72baa9414e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:41.492842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085f4d-fe21-48ef-8be1-3e4ab92f0f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:41.493659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085f4d-fe21-48ef-8be1-3e4ab92f0f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:41.494007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085f4d-fe21-48ef-8be1-3e4ab92f0f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:41.494320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085f4d-fe21-48ef-8be1-3e4ab92f0f20 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:41.495180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab085f4d-fe21-48ef-8be1-3e4ab92f0f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:41.497209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab085f4d-fe21-48ef-8be1-3e4ab92f0f20 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:41.546201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 852/1690] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:41 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:41.547489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa413c-91db-4b2b-a7e0-431327c1615a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:41.563141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa413c-91db-4b2b-a7e0-431327c1615a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:41.578769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2be48-edd5-4410-8a38-9d2b76721dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:41.579536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2be48-edd5-4410-8a38-9d2b76721dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:41.580119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2be48-edd5-4410-8a38-9d2b76721dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:41.580714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2be48-edd5-4410-8a38-9d2b76721dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:41.581551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2be48-edd5-4410-8a38-9d2b76721dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:41.584571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2be48-edd5-4410-8a38-9d2b76721dbf admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:41.624465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 839/1691] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:41.625900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085f4d-fe21-48ef-8be1-3e4ab92f0f20 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:41.640780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085f4d-fe21-48ef-8be1-3e4ab92f0f20 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:41.665057 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3a53-3dd0-4e5a-a4f4-e8d93ab970ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:41.666557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3a53-3dd0-4e5a-a4f4-e8d93ab970ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:41.666557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3a53-3dd0-4e5a-a4f4-e8d93ab970ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:41.666818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3a53-3dd0-4e5a-a4f4-e8d93ab970ef admin admin] PATH_INFO: `/v3/projects/d1596f526b3b4a1192dea820b7f54291/users/f6aa33185c0f4398b8256e5c2c696767/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:41.716484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3a53-3dd0-4e5a-a4f4-e8d93ab970ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1596f526b3b4a1192dea820b7f54291, user_id=f6aa33185c0f4398b8256e5c2c696767, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:41.720348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3a53-3dd0-4e5a-a4f4-e8d93ab970ef admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:41.739623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:41.775044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 853/1692] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:41 2022] PUT /identity/v3/projects/d1596f526b3b4a1192dea820b7f54291/users/f6aa33185c0f4398b8256e5c2c696767/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:25:41.778906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2be48-edd5-4410-8a38-9d2b76721dbf admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:41.794818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2be48-edd5-4410-8a38-9d2b76721dbf admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:41.820095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:41.963379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780b9e6-4a10-4f01-840b-2b6f6e5099dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:41.965094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780b9e6-4a10-4f01-840b-2b6f6e5099dc admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:41.966268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780b9e6-4a10-4f01-840b-2b6f6e5099dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:41.966911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780b9e6-4a10-4f01-840b-2b6f6e5099dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:41.969056 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780b9e6-4a10-4f01-840b-2b6f6e5099dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:41.972539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780b9e6-4a10-4f01-840b-2b6f6e5099dc admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:42.005488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 840/1693] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:42.009092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3a53-3dd0-4e5a-a4f4-e8d93ab970ef admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:42.033205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3a53-3dd0-4e5a-a4f4-e8d93ab970ef admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:42.045786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f6407-a8e1-4fcd-8652-ff896607eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:42.046991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6407-a8e1-4fcd-8652-ff896607eb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:42.052156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6407-a8e1-4fcd-8652-ff896607eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:42.052449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6407-a8e1-4fcd-8652-ff896607eb72 admin admin] PATH_INFO: `/v3/projects/d1596f526b3b4a1192dea820b7f54291/users/f6aa33185c0f4398b8256e5c2c696767/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:42.061679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f6407-a8e1-4fcd-8652-ff896607eb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1596f526b3b4a1192dea820b7f54291, user_id=f6aa33185c0f4398b8256e5c2c696767, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:42.064933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f6407-a8e1-4fcd-8652-ff896607eb72 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:42.093424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 854/1694] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:42 2022] PUT /identity/v3/projects/d1596f526b3b4a1192dea820b7f54291/users/f6aa33185c0f4398b8256e5c2c696767/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:25:42.105569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383af88-1175-4b1e-b1b6-6bdd59d7acaf None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:42.106259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383af88-1175-4b1e-b1b6-6bdd59d7acaf None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:42.106949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383af88-1175-4b1e-b1b6-6bdd59d7acaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:42.207950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-5383af88-1175-4b1e-b1b6-6bdd59d7acaf None None] MFA Rules not processed for user `f6aa33185c0f4398b8256e5c2c696767`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:42.213052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5383af88-1175-4b1e-b1b6-6bdd59d7acaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:42.480187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 841/1695] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:42.494079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f6407-a8e1-4fcd-8652-ff896607eb72 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:42.496905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7a3f6407-a8e1-4fcd-8652-ff896607eb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:42.689135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f6407-a8e1-4fcd-8652-ff896607eb72 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:42.706109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e9079-e99d-4a8d-b645-e5eac16c303b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:42.707462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e9079-e99d-4a8d-b645-e5eac16c303b service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:42.707904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e9079-e99d-4a8d-b645-e5eac16c303b service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:42.708321 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e9079-e99d-4a8d-b645-e5eac16c303b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:42.746591 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e9079-e99d-4a8d-b645-e5eac16c303b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:42.748891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e9079-e99d-4a8d-b645-e5eac16c303b service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:42.757262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe823a-8d54-43b7-9274-963cab3d0703 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:42.757904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe823a-8d54-43b7-9274-963cab3d0703 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:42.758411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe823a-8d54-43b7-9274-963cab3d0703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:42.794149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 855/1696] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:42.831347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-cdbe823a-8d54-43b7-9274-963cab3d0703 None None] MFA Rules not processed for user `7bfbf57be6fd4ef3b7ea3f6b7519e414`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:42.835112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-cdbe823a-8d54-43b7-9274-963cab3d0703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:42.979262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 842/1697] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:42 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:25:42.984121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e9079-e99d-4a8d-b645-e5eac16c303b service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:42.985800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-678e9079-e99d-4a8d-b645-e5eac16c303b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:43.047548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe823a-8d54-43b7-9274-963cab3d0703 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:43.061211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe823a-8d54-43b7-9274-963cab3d0703 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:43.078146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfa093-baa6-491f-aea1-48ae9a98316e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:43.078887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfa093-baa6-491f-aea1-48ae9a98316e service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:43.079242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfa093-baa6-491f-aea1-48ae9a98316e service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:43.079594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfa093-baa6-491f-aea1-48ae9a98316e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:43.168484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:43.222993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e9079-e99d-4a8d-b645-e5eac16c303b service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:43.240272 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2783c-7201-4293-a2e2-cb25f98955a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:43.240956 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2783c-7201-4293-a2e2-cb25f98955a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:43.241292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2783c-7201-4293-a2e2-cb25f98955a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:43.241592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2783c-7201-4293-a2e2-cb25f98955a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:43.244650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2783c-7201-4293-a2e2-cb25f98955a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:43.249727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2783c-7201-4293-a2e2-cb25f98955a0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:43.296037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfa093-baa6-491f-aea1-48ae9a98316e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:43.299654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfa093-baa6-491f-aea1-48ae9a98316e service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:43.328441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 856/1698] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:42 2022] POST /identity/v3/projects => generated 405 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:25:43.330062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580d411-c428-4e9e-9495-44a0670b5ed5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:43.330358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580d411-c428-4e9e-9495-44a0670b5ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:43.330638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580d411-c428-4e9e-9495-44a0670b5ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:43.353116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 843/1699] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:43.354073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfa093-baa6-491f-aea1-48ae9a98316e service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:43.366377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d580d411-c428-4e9e-9495-44a0670b5ed5 None None] MFA Rules not processed for user `c334003dcc634b4c86ba14c542fb60aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:43.369510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d580d411-c428-4e9e-9495-44a0670b5ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:43.383511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfa093-baa6-491f-aea1-48ae9a98316e service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:43.564017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb74f-ace2-417e-8247-57bc8f2baf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:43.565135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb74f-ace2-417e-8247-57bc8f2baf85 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:43.565452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb74f-ace2-417e-8247-57bc8f2baf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:43.567360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb74f-ace2-417e-8247-57bc8f2baf85 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:43.568069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb74f-ace2-417e-8247-57bc8f2baf85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:43.572887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 857/1700] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:43.573419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb74f-ace2-417e-8247-57bc8f2baf85 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:43.633369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580d411-c428-4e9e-9495-44a0670b5ed5 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:43.640912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 844/1701] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:43 2022] POST /identity/v3/users => generated 309 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:43.654954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580d411-c428-4e9e-9495-44a0670b5ed5 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:43.675714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb363-1dee-4d4b-87dc-af971f181d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:43.678599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb363-1dee-4d4b-87dc-af971f181d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:43.680493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb363-1dee-4d4b-87dc-af971f181d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:43.683856 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb363-1dee-4d4b-87dc-af971f181d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:43.684603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bb363-1dee-4d4b-87dc-af971f181d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:43.686383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bb363-1dee-4d4b-87dc-af971f181d28 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:43.728664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 858/1702] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:43.740467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb74f-ace2-417e-8247-57bc8f2baf85 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:43.773798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb74f-ace2-417e-8247-57bc8f2baf85 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:43.820906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9783c4-a69f-4193-a904-b466711b82c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:43.824773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9783c4-a69f-4193-a904-b466711b82c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:43.825059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9783c4-a69f-4193-a904-b466711b82c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:43.827938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9783c4-a69f-4193-a904-b466711b82c8 admin admin] PATH_INFO: `/v3/projects/2e2a0a566a6d41248f9c872de31b69e1/users/156c9031598a4d75bcc8beb13e3b69eb/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:43.918383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9783c4-a69f-4193-a904-b466711b82c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2a0a566a6d41248f9c872de31b69e1, user_id=156c9031598a4d75bcc8beb13e3b69eb, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:43.921583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9783c4-a69f-4193-a904-b466711b82c8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:43.945414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 845/1703] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:43 2022] PUT /identity/v3/projects/2e2a0a566a6d41248f9c872de31b69e1/users/156c9031598a4d75bcc8beb13e3b69eb/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:43.951276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb363-1dee-4d4b-87dc-af971f181d28 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:43.961471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:43.977812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb363-1dee-4d4b-87dc-af971f181d28 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:44.209394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da11829-6e41-44c9-aa40-b6116b40cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:44.211032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da11829-6e41-44c9-aa40-b6116b40cfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:44.211032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da11829-6e41-44c9-aa40-b6116b40cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:44.211032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da11829-6e41-44c9-aa40-b6116b40cfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:44.211614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da11829-6e41-44c9-aa40-b6116b40cfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:44.213283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da11829-6e41-44c9-aa40-b6116b40cfe0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:44.234423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9783c4-a69f-4193-a904-b466711b82c8 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:44.235218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 859/1704] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:44.248206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9783c4-a69f-4193-a904-b466711b82c8 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:44.271018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b7b10-8213-4338-8495-74eeff7d0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:44.272067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b7b10-8213-4338-8495-74eeff7d0f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:44.272551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b7b10-8213-4338-8495-74eeff7d0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:44.273021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b7b10-8213-4338-8495-74eeff7d0f8e admin admin] PATH_INFO: `/v3/projects/2e2a0a566a6d41248f9c872de31b69e1/users/156c9031598a4d75bcc8beb13e3b69eb/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:44.276783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b7b10-8213-4338-8495-74eeff7d0f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2a0a566a6d41248f9c872de31b69e1, user_id=156c9031598a4d75bcc8beb13e3b69eb, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:44.284013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b7b10-8213-4338-8495-74eeff7d0f8e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:44.301437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 846/1705] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:44 2022] PUT /identity/v3/projects/2e2a0a566a6d41248f9c872de31b69e1/users/156c9031598a4d75bcc8beb13e3b69eb/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:25:44.702682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117bf9-9ebf-4300-9862-ccb4270657e1 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:44.703083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117bf9-9ebf-4300-9862-ccb4270657e1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:44.703624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117bf9-9ebf-4300-9862-ccb4270657e1 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:44.705274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 860/1706] 10.222.0.61 () {54 vars in 912 bytes} [Thu Sep 22 18:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:25:44.711807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aa7db-de9f-4b07-a891-609bd01686e4 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:44.712255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aa7db-de9f-4b07-a891-609bd01686e4 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:44.712537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aa7db-de9f-4b07-a891-609bd01686e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:44.799728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-725aa7db-de9f-4b07-a891-609bd01686e4 None None] MFA Rules not processed for user `8d0b8fc336694043a34f007b78c45c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:44.808835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-725aa7db-de9f-4b07-a891-609bd01686e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:44.950794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 847/1707] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:25:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:25:45.043799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c117bf9-9ebf-4300-9862-ccb4270657e1 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:45.046225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1c117bf9-9ebf-4300-9862-ccb4270657e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:45.082567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c117bf9-9ebf-4300-9862-ccb4270657e1 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:45.098443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bcb9d-bb90-4f7a-a69a-57e6b0d3fe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:45.104500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bcb9d-bb90-4f7a-a69a-57e6b0d3fe16 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:45.104889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bcb9d-bb90-4f7a-a69a-57e6b0d3fe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:45.105175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bcb9d-bb90-4f7a-a69a-57e6b0d3fe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:45.130278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bcb9d-bb90-4f7a-a69a-57e6b0d3fe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:45.131763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bcb9d-bb90-4f7a-a69a-57e6b0d3fe16 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:45.155378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 861/1708] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:46.297039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815a3c-b1dc-4400-92cb-d2ae5667cf61 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:46.297765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815a3c-b1dc-4400-92cb-d2ae5667cf61 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:46.297965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815a3c-b1dc-4400-92cb-d2ae5667cf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:46.419915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:46.431783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-39815a3c-b1dc-4400-92cb-d2ae5667cf61 None None] MFA Rules not processed for user `626b85e5875b4d47b410f4f43aca0497`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:46.435677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-39815a3c-b1dc-4400-92cb-d2ae5667cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:46.711852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 848/1709] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:46.728138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bcb9d-bb90-4f7a-a69a-57e6b0d3fe16 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:46.729969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6b3bcb9d-bb90-4f7a-a69a-57e6b0d3fe16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:46.875284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d45b0-9bea-4380-9fed-5f41124f9910 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:46.875730 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d45b0-9bea-4380-9fed-5f41124f9910 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:46.876287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d45b0-9bea-4380-9fed-5f41124f9910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:46.989220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e56d45b0-9bea-4380-9fed-5f41124f9910 None None] MFA Rules not processed for user `156c9031598a4d75bcc8beb13e3b69eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:46.990909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e56d45b0-9bea-4380-9fed-5f41124f9910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:47.083444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bcb9d-bb90-4f7a-a69a-57e6b0d3fe16 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:47.109606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6bb27-b590-4205-93b7-41ee14ba60e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:47.111336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6bb27-b590-4205-93b7-41ee14ba60e6 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:47.111626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6bb27-b590-4205-93b7-41ee14ba60e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:47.111907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6bb27-b590-4205-93b7-41ee14ba60e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:47.132958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6bb27-b590-4205-93b7-41ee14ba60e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:47.134619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6bb27-b590-4205-93b7-41ee14ba60e6 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:47.163315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 862/1710] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:25:47.164364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6bb27-b590-4205-93b7-41ee14ba60e6 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:47.166457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-55a6bb27-b590-4205-93b7-41ee14ba60e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:47.254843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 849/1711] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:47.424357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6bb27-b590-4205-93b7-41ee14ba60e6 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:47.459756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aee6f7-fa78-4cfd-ba50-154cf62fa498 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:47.460685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aee6f7-fa78-4cfd-ba50-154cf62fa498 service placement] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:47.460987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aee6f7-fa78-4cfd-ba50-154cf62fa498 service placement] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:47.461342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aee6f7-fa78-4cfd-ba50-154cf62fa498 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:47.467709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-50aee6f7-fa78-4cfd-ba50-154cf62fa498 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:47.503469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aee6f7-fa78-4cfd-ba50-154cf62fa498 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:47.507281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aee6f7-fa78-4cfd-ba50-154cf62fa498 service placement] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:47.534122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 863/1712] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:49.716987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35424-cbb7-45c1-af0e-19b04e6150d0 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:49.717617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35424-cbb7-45c1-af0e-19b04e6150d0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:49.717876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35424-cbb7-45c1-af0e-19b04e6150d0 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:49.719559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 850/1713] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:25:49.782464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef7f0-3094-4667-8442-5b05facc11ae None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:49.783000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef7f0-3094-4667-8442-5b05facc11ae None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:49.783457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef7f0-3094-4667-8442-5b05facc11ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:49.797691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:49.844891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d22ef7f0-3094-4667-8442-5b05facc11ae None None] MFA Rules not processed for user `e42268a8b5944cbd9508a07c037112e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:49.846580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d22ef7f0-3094-4667-8442-5b05facc11ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:49.869644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 864/1714] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:25:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:49.984199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35424-cbb7-45c1-af0e-19b04e6150d0 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:50.009049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35424-cbb7-45c1-af0e-19b04e6150d0 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:50.021436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a560-1180-47a2-90ce-2de78ff9e177 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:50.023219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a560-1180-47a2-90ce-2de78ff9e177 service placement] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:50.023873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a560-1180-47a2-90ce-2de78ff9e177 service placement] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:50.024388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a560-1180-47a2-90ce-2de78ff9e177 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:50.043219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45a560-1180-47a2-90ce-2de78ff9e177 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:50.046694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45a560-1180-47a2-90ce-2de78ff9e177 service placement] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:50.065422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cea548-dfaa-4b20-a33e-1a0e9a2dfd46 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:50.066235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cea548-dfaa-4b20-a33e-1a0e9a2dfd46 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:50.066735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cea548-dfaa-4b20-a33e-1a0e9a2dfd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:50.091852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 851/1715] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:50.130375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c5cea548-dfaa-4b20-a33e-1a0e9a2dfd46 None None] MFA Rules not processed for user `84194be302944432b193bdbfd2e6ddf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:50.134421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c5cea548-dfaa-4b20-a33e-1a0e9a2dfd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:50.300462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 865/1716] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:25:50.311523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d764dc0-928c-4467-9cad-2a325d0e3019 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:50.311812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d764dc0-928c-4467-9cad-2a325d0e3019 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:50.312119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d764dc0-928c-4467-9cad-2a325d0e3019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:50.344277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4d764dc0-928c-4467-9cad-2a325d0e3019 None None] MFA Rules not processed for user `84194be302944432b193bdbfd2e6ddf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:50.351070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4d764dc0-928c-4467-9cad-2a325d0e3019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:50.369545 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 852/1717] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:50.383833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cea548-dfaa-4b20-a33e-1a0e9a2dfd46 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:50.385313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c5cea548-dfaa-4b20-a33e-1a0e9a2dfd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:50.416422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cea548-dfaa-4b20-a33e-1a0e9a2dfd46 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:50.444689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce61f6-ed8c-4b04-a02a-8b5ceb1384c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:50.446215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce61f6-ed8c-4b04-a02a-8b5ceb1384c6 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:50.446755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce61f6-ed8c-4b04-a02a-8b5ceb1384c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:50.447277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce61f6-ed8c-4b04-a02a-8b5ceb1384c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:50.461848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce61f6-ed8c-4b04-a02a-8b5ceb1384c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:50.463683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce61f6-ed8c-4b04-a02a-8b5ceb1384c6 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:50.499708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 866/1718] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:50.835900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1c021-a24a-4cc7-9fe4-480c7a6d1281 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:50.836469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1c021-a24a-4cc7-9fe4-480c7a6d1281 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:50.836636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1c021-a24a-4cc7-9fe4-480c7a6d1281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:50.918518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce61f6-ed8c-4b04-a02a-8b5ceb1384c6 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:50.920415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-57ce61f6-ed8c-4b04-a02a-8b5ceb1384c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:50.961732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3de1c021-a24a-4cc7-9fe4-480c7a6d1281 None None] MFA Rules not processed for user `36d7b059ff874d0db44ceecb2f95830c`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:50.970239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3de1c021-a24a-4cc7-9fe4-480c7a6d1281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:51.092966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce61f6-ed8c-4b04-a02a-8b5ceb1384c6 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:51.117805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:51.119704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:51.119997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:51.120280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] PATH_INFO: `/v3/users/d8465173ae514333b70180a7c2c06968` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:51.128744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8465173ae514333b70180a7c2c06968)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:51.135611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:51.188660 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:51.228266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 853/1719] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:51.239473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2997-e0f2-4b4d-bce6-e78ecf820f97 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:51.239858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2997-e0f2-4b4d-bce6-e78ecf820f97 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:51.240146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2997-e0f2-4b4d-bce6-e78ecf820f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:51.272792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-239e2997-e0f2-4b4d-bce6-e78ecf820f97 None None] MFA Rules not processed for user `36d7b059ff874d0db44ceecb2f95830c`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:51.274927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-239e2997-e0f2-4b4d-bce6-e78ecf820f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:51.289044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 854/1720] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:51.328122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8465173ae514333b70180a7c2c06968'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:51.340580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8465173ae514333b70180a7c2c06968'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:51.341078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8465173ae514333b70180a7c2c06968'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:51.393802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8465173ae514333b70180a7c2c06968'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:51.403759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:51.434899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-54775a5a-d9a5-4277-8c3f-18407bf79c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8465173ae514333b70180a7c2c06968'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:51.464670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 867/1721] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:25:50 2022] DELETE /identity/v3/users/d8465173ae514333b70180a7c2c06968 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:51.469169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffac9c2-ef82-4434-9067-e3ded81df191 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:51.469493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffac9c2-ef82-4434-9067-e3ded81df191 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:51.469939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffac9c2-ef82-4434-9067-e3ded81df191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:51.532988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd60b95-5e28-4ba1-a9ce-7792f01413c7 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:51.533537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd60b95-5e28-4ba1-a9ce-7792f01413c7 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:51.534017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd60b95-5e28-4ba1-a9ce-7792f01413c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:51.551653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6ffac9c2-ef82-4434-9067-e3ded81df191 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:51.556400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6ffac9c2-ef82-4434-9067-e3ded81df191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:51.680195 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-9dd60b95-5e28-4ba1-a9ce-7792f01413c7 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:51.681666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9dd60b95-5e28-4ba1-a9ce-7792f01413c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:51.803248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 855/1722] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:51.805453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffac9c2-ef82-4434-9067-e3ded81df191 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:51.808864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6ffac9c2-ef82-4434-9067-e3ded81df191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:51.904595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 868/1723] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:25:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:25:51.905779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd60b95-5e28-4ba1-a9ce-7792f01413c7 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:51.908804 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9dd60b95-5e28-4ba1-a9ce-7792f01413c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:52.036943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd60b95-5e28-4ba1-a9ce-7792f01413c7 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:52.042461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4892c-0bb1-48d3-b38e-ce4bf13e018f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:52.043627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4892c-0bb1-48d3-b38e-ce4bf13e018f service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:52.044078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4892c-0bb1-48d3-b38e-ce4bf13e018f service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:52.044440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4892c-0bb1-48d3-b38e-ce4bf13e018f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:52.058787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4892c-0bb1-48d3-b38e-ce4bf13e018f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:52.061763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4892c-0bb1-48d3-b38e-ce4bf13e018f service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:52.076434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 869/1724] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:52.085398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffac9c2-ef82-4434-9067-e3ded81df191 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:52.107783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f638d6-b73f-4b1f-a11d-ed902b028e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:52.109191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f638d6-b73f-4b1f-a11d-ed902b028e51 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:52.109522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f638d6-b73f-4b1f-a11d-ed902b028e51 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:52.109796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f638d6-b73f-4b1f-a11d-ed902b028e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:52.111683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b5f638d6-b73f-4b1f-a11d-ed902b028e51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:52.182961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4892c-0bb1-48d3-b38e-ce4bf13e018f service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:52.185014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3cd4892c-0bb1-48d3-b38e-ce4bf13e018f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:52.261188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f638d6-b73f-4b1f-a11d-ed902b028e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:52.262784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f638d6-b73f-4b1f-a11d-ed902b028e51 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:52.286095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 856/1725] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:52.469576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:52.518669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4892c-0bb1-48d3-b38e-ce4bf13e018f service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:52.531516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97667499-6ab4-448a-b4d6-91d6b6c4d5a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:52.536020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97667499-6ab4-448a-b4d6-91d6b6c4d5a4 service swift] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:52.536324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97667499-6ab4-448a-b4d6-91d6b6c4d5a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:52.536803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97667499-6ab4-448a-b4d6-91d6b6c4d5a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:52.552971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97667499-6ab4-448a-b4d6-91d6b6c4d5a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:52.555502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97667499-6ab4-448a-b4d6-91d6b6c4d5a4 service swift] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:52.575557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 870/1726] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:25:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 18:25:52.859899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a05a9-4bdd-49df-8a07-395c26ae21d8 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:52.860642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a05a9-4bdd-49df-8a07-395c26ae21d8 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:52.861141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a05a9-4bdd-49df-8a07-395c26ae21d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:52.898830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-064a05a9-4bdd-49df-8a07-395c26ae21d8 None None] MFA Rules not processed for user `626b85e5875b4d47b410f4f43aca0497`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:52.900503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-064a05a9-4bdd-49df-8a07-395c26ae21d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:52.952496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:53.043802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 857/1727] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:53.072267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97667499-6ab4-448a-b4d6-91d6b6c4d5a4 service swift] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:53.077823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-97667499-6ab4-448a-b4d6-91d6b6c4d5a4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:53.105125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97667499-6ab4-448a-b4d6-91d6b6c4d5a4 service swift] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:53.117998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:53.118800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:53.119180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:53.119564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] PATH_INFO: `/v3/users/7bfbf57be6fd4ef3b7ea3f6b7519e414` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:53.121732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bfbf57be6fd4ef3b7ea3f6b7519e414)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:53.123865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:53.207824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a05a9-4bdd-49df-8a07-395c26ae21d8 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:53.210018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-064a05a9-4bdd-49df-8a07-395c26ae21d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:53.239788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a05a9-4bdd-49df-8a07-395c26ae21d8 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:53.240596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bfbf57be6fd4ef3b7ea3f6b7519e414'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.270350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:53.271046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bfbf57be6fd4ef3b7ea3f6b7519e414'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.272087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bfbf57be6fd4ef3b7ea3f6b7519e414'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.274098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:53.274393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:53.275705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] PATH_INFO: `/v3/users/9cfad8a814a9432895d9db9925a23542` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:53.278436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cfad8a814a9432895d9db9925a23542)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:53.290055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:53.315510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bfbf57be6fd4ef3b7ea3f6b7519e414'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.342756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-86f26e5a-9e18-47ca-8dac-0034e9cbc3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bfbf57be6fd4ef3b7ea3f6b7519e414'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.364057 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 871/1728] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:25:53 2022] DELETE /identity/v3/users/7bfbf57be6fd4ef3b7ea3f6b7519e414 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:25:53.451911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cfad8a814a9432895d9db9925a23542'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.474502 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cfad8a814a9432895d9db9925a23542'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.479274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cfad8a814a9432895d9db9925a23542'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.549920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cfad8a814a9432895d9db9925a23542'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.568491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95390572-d902-4d36-8907-dd27f733f98a None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:53.568842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95390572-d902-4d36-8907-dd27f733f98a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:53.569048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95390572-d902-4d36-8907-dd27f733f98a None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:53.570780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 872/1729] 10.222.0.61 () {54 vars in 912 bytes} [Thu Sep 22 18:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:25:53.579282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9cccf-df7f-4d4f-9861-2e3205a91e4d None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:53.579588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9cccf-df7f-4d4f-9861-2e3205a91e4d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:53.579850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9cccf-df7f-4d4f-9861-2e3205a91e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:53.593796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0375fa34-ad24-4f4a-a139-e64410b628ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cfad8a814a9432895d9db9925a23542'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:53.623315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 858/1730] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:25:53 2022] DELETE /identity/v3/users/9cfad8a814a9432895d9db9925a23542 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:25:53.626585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-34f9cccf-df7f-4d4f-9861-2e3205a91e4d None None] MFA Rules not processed for user `8d0b8fc336694043a34f007b78c45c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:53.626700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-34f9cccf-df7f-4d4f-9861-2e3205a91e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:53.632091 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b192-755e-4b64-9bcf-4b6a8dc22c04 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:53.632910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b192-755e-4b64-9bcf-4b6a8dc22c04 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:53.633457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b192-755e-4b64-9bcf-4b6a8dc22c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:53.692375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6ad9b192-755e-4b64-9bcf-4b6a8dc22c04 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:53.694223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6ad9b192-755e-4b64-9bcf-4b6a8dc22c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:53.782653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 873/1731] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:25:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:25:53.827814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9cccf-df7f-4d4f-9861-2e3205a91e4d None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:53.829349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-34f9cccf-df7f-4d4f-9861-2e3205a91e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:53.852180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9cccf-df7f-4d4f-9861-2e3205a91e4d None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:53.864068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1403691-4564-4720-829c-7e61f3c28d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:53.864732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1403691-4564-4720-829c-7e61f3c28d89 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:53.865165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1403691-4564-4720-829c-7e61f3c28d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:53.865511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1403691-4564-4720-829c-7e61f3c28d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:53.882925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 859/1732] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:53.887503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1403691-4564-4720-829c-7e61f3c28d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:53.888999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1403691-4564-4720-829c-7e61f3c28d89 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:53.901573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b192-755e-4b64-9bcf-4b6a8dc22c04 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:53.903226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6ad9b192-755e-4b64-9bcf-4b6a8dc22c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:53.907674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 874/1733] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:25:53.947198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b192-755e-4b64-9bcf-4b6a8dc22c04 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:53.995475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63fc0-4756-40da-ab82-a58756f9a603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:53.996141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63fc0-4756-40da-ab82-a58756f9a603 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:53.996422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63fc0-4756-40da-ab82-a58756f9a603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:53.996869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63fc0-4756-40da-ab82-a58756f9a603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:54.017780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b63fc0-4756-40da-ab82-a58756f9a603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:54.019374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b63fc0-4756-40da-ab82-a58756f9a603 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:54.056148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 860/1734] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:25:54.214510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1403691-4564-4720-829c-7e61f3c28d89 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:54.217209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d1403691-4564-4720-829c-7e61f3c28d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:54.257671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1403691-4564-4720-829c-7e61f3c28d89 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:54.273986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:54.275838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:54.276149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:54.276429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] PATH_INFO: `/v3/projects/498df6f50ae94707a05b409862d19936` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:54.279597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498df6f50ae94707a05b409862d19936)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:54.286068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:54.373551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:54.393400 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498df6f50ae94707a05b409862d19936', 'request_id': 'req-2520d990-88a8-4a2b-8d8e-280a3eeefb38'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:54.414173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498df6f50ae94707a05b409862d19936', 'request_id': 'req-2520d990-88a8-4a2b-8d8e-280a3eeefb38'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:54.423094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498df6f50ae94707a05b409862d19936', 'request_id': 'req-2520d990-88a8-4a2b-8d8e-280a3eeefb38'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:54.485368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] The token cache is being invalidate because project 498df6f50ae94707a05b409862d19936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:25:54.487233 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:54.492223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:54.495196 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 875/1735] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:25:54 2022] DELETE /identity/v3/projects/498df6f50ae94707a05b409862d19936 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:54.499413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63fc0-4756-40da-ab82-a58756f9a603 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:54.515750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63fc0-4756-40da-ab82-a58756f9a603 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:54.697799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:54.796051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f556b-773b-49de-993c-78022545e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:54.796716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f556b-773b-49de-993c-78022545e166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:54.797003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f556b-773b-49de-993c-78022545e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:54.797709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f556b-773b-49de-993c-78022545e166 admin admin] PATH_INFO: `/v3/users/156c9031598a4d75bcc8beb13e3b69eb` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:54.800091 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f556b-773b-49de-993c-78022545e166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=156c9031598a4d75bcc8beb13e3b69eb)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:54.802377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f556b-773b-49de-993c-78022545e166 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:54.954626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-267f556b-773b-49de-993c-78022545e166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156c9031598a4d75bcc8beb13e3b69eb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:54.979210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-267f556b-773b-49de-993c-78022545e166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156c9031598a4d75bcc8beb13e3b69eb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:54.979962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-267f556b-773b-49de-993c-78022545e166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156c9031598a4d75bcc8beb13e3b69eb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:55.015950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-267f556b-773b-49de-993c-78022545e166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156c9031598a4d75bcc8beb13e3b69eb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:55.036343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-267f556b-773b-49de-993c-78022545e166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156c9031598a4d75bcc8beb13e3b69eb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:55.057048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:55.058981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:55.062333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 861/1736] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:25:54 2022] DELETE /identity/v3/users/156c9031598a4d75bcc8beb13e3b69eb => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:55.100733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520d990-88a8-4a2b-8d8e-280a3eeefb38 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:55.352637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:55.356471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:55.357600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:55.359101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] PATH_INFO: `/v3/projects/a4f9d6bda9e94e9d9411b2650b43db79` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:55.365566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4f9d6bda9e94e9d9411b2650b43db79)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:55.385927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:55.587085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4f9d6bda9e94e9d9411b2650b43db79', 'request_id': 'req-31290884-fc7a-439c-ba27-1549286855ce'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:55.604822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4f9d6bda9e94e9d9411b2650b43db79', 'request_id': 'req-31290884-fc7a-439c-ba27-1549286855ce'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:55.630508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4f9d6bda9e94e9d9411b2650b43db79', 'request_id': 'req-31290884-fc7a-439c-ba27-1549286855ce'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:55.697255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] The token cache is being invalidate because project a4f9d6bda9e94e9d9411b2650b43db79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:25:55.699478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:55.702384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f556b-773b-49de-993c-78022545e166 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:55.703770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-267f556b-773b-49de-993c-78022545e166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:55.733743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:55.751866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 876/1737] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:25:55 2022] DELETE /identity/v3/projects/a4f9d6bda9e94e9d9411b2650b43db79 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:25:55.758123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:55.763080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:55.778104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f556b-773b-49de-993c-78022545e166 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:55.966636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:55.971144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290884-fc7a-439c-ba27-1549286855ce admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:55.980655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:55.985661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:55.985661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:55.985661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] PATH_INFO: `/v3/users/f6aa33185c0f4398b8256e5c2c696767` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:55.985661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6aa33185c0f4398b8256e5c2c696767)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:55.987246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:56.100123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6aa33185c0f4398b8256e5c2c696767'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.109643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6aa33185c0f4398b8256e5c2c696767'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.110541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6aa33185c0f4398b8256e5c2c696767'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.145681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:56.146953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:56.151731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:56.155756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6aa33185c0f4398b8256e5c2c696767'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.157266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] PATH_INFO: `/v3/projects/2e2a0a566a6d41248f9c872de31b69e1` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:56.164746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2a0a566a6d41248f9c872de31b69e1)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:56.184788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:56.193330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-705e4c06-c157-47ba-acef-c7b97717f172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6aa33185c0f4398b8256e5c2c696767'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.214645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 877/1738] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:25:55 2022] DELETE /identity/v3/users/f6aa33185c0f4398b8256e5c2c696767 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:56.358195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2a0a566a6d41248f9c872de31b69e1', 'request_id': 'req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.366454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:56.383158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2a0a566a6d41248f9c872de31b69e1', 'request_id': 'req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.413849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2a0a566a6d41248f9c872de31b69e1', 'request_id': 'req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.472662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] The token cache is being invalidate because project 2e2a0a566a6d41248f9c872de31b69e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:25:56.473060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.478182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ccf9ab-b5a6-4ad8-a2b6-e755d7820f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:56.479950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 862/1739] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:25:55 2022] DELETE /identity/v3/projects/2e2a0a566a6d41248f9c872de31b69e1 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:56.485716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839a702-c248-4429-8ec6-03c95b030273 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:56.487782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839a702-c248-4429-8ec6-03c95b030273 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:56.488282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839a702-c248-4429-8ec6-03c95b030273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:56.563431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5839a702-c248-4429-8ec6-03c95b030273 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:56.566578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5839a702-c248-4429-8ec6-03c95b030273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:56.775637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 878/1740] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:56.783304 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea31d8-be07-44d5-aee5-7b5158ebef6a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:56.783871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea31d8-be07-44d5-aee5-7b5158ebef6a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:56.784377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea31d8-be07-44d5-aee5-7b5158ebef6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:56.865618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d2ea31d8-be07-44d5-aee5-7b5158ebef6a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:56.870138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d2ea31d8-be07-44d5-aee5-7b5158ebef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:56.891962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 863/1741] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:56.896715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839a702-c248-4429-8ec6-03c95b030273 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:56.914364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839a702-c248-4429-8ec6-03c95b030273 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:56.930776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:56.931496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:56.931859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:56.932213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:56.932959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:56.933369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:56.940609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:57.020024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea31d8-be07-44d5-aee5-7b5158ebef6a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:57.030571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 879/1742] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:57.039714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea31d8-be07-44d5-aee5-7b5158ebef6a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:57.060611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:57.063585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:57.076133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3ca62-9b93-4505-984a-9bc6a8301636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:57.077052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3ca62-9b93-4505-984a-9bc6a8301636 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:57.077649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3ca62-9b93-4505-984a-9bc6a8301636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:57.078801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3ca62-9b93-4505-984a-9bc6a8301636 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:57.090570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3ca62-9b93-4505-984a-9bc6a8301636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:57.094049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3ca62-9b93-4505-984a-9bc6a8301636 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:57.128744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb6c9b-38d4-41d9-943e-ffddd123721f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:57.155746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 864/1743] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:57 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:25:57.161497 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3ca62-9b93-4505-984a-9bc6a8301636 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:57.172168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:57.172718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-10d3ca62-9b93-4505-984a-9bc6a8301636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:57.173019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:57.174104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:57.174403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] PATH_INFO: `/v3/projects/b298475976aa454ab4224fc3ddeb81e9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:57.177786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b298475976aa454ab4224fc3ddeb81e9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:57.179747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:57.344395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3ca62-9b93-4505-984a-9bc6a8301636 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:57.414873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b298475976aa454ab4224fc3ddeb81e9', 'request_id': 'req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.448720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b298475976aa454ab4224fc3ddeb81e9', 'request_id': 'req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.456097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:57.474527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b298475976aa454ab4224fc3ddeb81e9', 'request_id': 'req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.516315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] The token cache is being invalidate because project b298475976aa454ab4224fc3ddeb81e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:25:57.526563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.528161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.530803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:57.531056 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:57.531321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:57.531602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] PATH_INFO: `/v3/projects/d1596f526b3b4a1192dea820b7f54291` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:57.536293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 880/1744] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:25:57 2022] DELETE /identity/v3/projects/b298475976aa454ab4224fc3ddeb81e9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:57.537544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1596f526b3b4a1192dea820b7f54291)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:57.539318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:57.542912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:57.543077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:57.588845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787161ba-2b7f-4e42-8744-b3b9cbfa87d5 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:57.604541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b33881-c207-4723-b4a7-74449802730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:57.608904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33881-c207-4723-b4a7-74449802730a admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:57.609530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33881-c207-4723-b4a7-74449802730a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:57.610006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33881-c207-4723-b4a7-74449802730a admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:57.614458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b33881-c207-4723-b4a7-74449802730a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:57.627259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b33881-c207-4723-b4a7-74449802730a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:57.718663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 881/1745] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:57 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:57.723692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b33881-c207-4723-b4a7-74449802730a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:57.728196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1596f526b3b4a1192dea820b7f54291', 'request_id': 'req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.740139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-24b33881-c207-4723-b4a7-74449802730a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:57.740581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1596f526b3b4a1192dea820b7f54291', 'request_id': 'req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.759488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:57.761172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1596f526b3b4a1192dea820b7f54291', 'request_id': 'req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.823341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b33881-c207-4723-b4a7-74449802730a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:57.824050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] The token cache is being invalidate because project d1596f526b3b4a1192dea820b7f54291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:25:57.824527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.838163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:57.851583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 865/1746] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:25:57 2022] DELETE /identity/v3/projects/d1596f526b3b4a1192dea820b7f54291 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:57.856052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:57.866676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:58.016603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:58.017316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.017611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.017907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] PATH_INFO: `/v3/users/62dc66359c154bea87ed58900c225b3d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:58.019803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=62dc66359c154bea87ed58900c225b3d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:58.025751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:58.052712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c48c3-fc4f-4a46-88af-92728dc6d7ae admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:58.059220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6edce-a515-4bc5-9160-9ff3eadf245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:58.061956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6edce-a515-4bc5-9160-9ff3eadf245b admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.062397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6edce-a515-4bc5-9160-9ff3eadf245b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.063372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6edce-a515-4bc5-9160-9ff3eadf245b admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:58.064353 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6edce-a515-4bc5-9160-9ff3eadf245b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:58.075887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6edce-a515-4bc5-9160-9ff3eadf245b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:58.110607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 866/1747] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:58.111765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699b9f5-8fb2-4123-9f55-ed9b719f3f69 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.112052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699b9f5-8fb2-4123-9f55-ed9b719f3f69 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.112329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699b9f5-8fb2-4123-9f55-ed9b719f3f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:58.161823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62dc66359c154bea87ed58900c225b3d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:58.169461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1699b9f5-8fb2-4123-9f55-ed9b719f3f69 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:58.181182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62dc66359c154bea87ed58900c225b3d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:58.186773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62dc66359c154bea87ed58900c225b3d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:58.189285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1699b9f5-8fb2-4123-9f55-ed9b719f3f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:58.218186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 867/1748] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:58.228995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b773e1b-cb96-4657-a774-6662ded30ba0 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.229636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b773e1b-cb96-4657-a774-6662ded30ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.229636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b773e1b-cb96-4657-a774-6662ded30ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:58.242640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62dc66359c154bea87ed58900c225b3d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:58.260343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62dc66359c154bea87ed58900c225b3d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:25:58.277980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 882/1749] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:25:57 2022] DELETE /identity/v3/users/62dc66359c154bea87ed58900c225b3d => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:58.278590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:58.286380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:58.296169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3b773e1b-cb96-4657-a774-6662ded30ba0 None None] MFA Rules not processed for user `8d0b8fc336694043a34f007b78c45c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:58.307933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3b773e1b-cb96-4657-a774-6662ded30ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:58.486871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:58.514808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 868/1750] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Sep 22 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:58.516220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831876e4-78a4-4dce-93a3-cc4c5b46853d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.517628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831876e4-78a4-4dce-93a3-cc4c5b46853d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.518069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831876e4-78a4-4dce-93a3-cc4c5b46853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:58.552444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89158e26-318a-4bf3-82c4-c88cc3e0ebeb admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:58.569484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc1d7b-3b00-42ea-9db0-e41eaef8cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:58.570194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc1d7b-3b00-42ea-9db0-e41eaef8cf80 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.570443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc1d7b-3b00-42ea-9db0-e41eaef8cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.571231 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc1d7b-3b00-42ea-9db0-e41eaef8cf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:58.572490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc1d7b-3b00-42ea-9db0-e41eaef8cf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:58.575106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc1d7b-3b00-42ea-9db0-e41eaef8cf80 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:58.580822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-831876e4-78a4-4dce-93a3-cc4c5b46853d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:58.593932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-831876e4-78a4-4dce-93a3-cc4c5b46853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:58.620540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 883/1751] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:58.622807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc1d7b-3b00-42ea-9db0-e41eaef8cf80 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:58.627404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 869/1752] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:58.631102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831876e4-78a4-4dce-93a3-cc4c5b46853d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:58.662968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831876e4-78a4-4dce-93a3-cc4c5b46853d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:58.667495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc1d7b-3b00-42ea-9db0-e41eaef8cf80 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:58.682882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:58.683527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.683812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.684089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:58.692205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:25:58.692479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:58.694075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe7608-dbd3-4a49-89c8-ce78f72c2b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:58.694907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe7608-dbd3-4a49-89c8-ce78f72c2b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.695347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe7608-dbd3-4a49-89c8-ce78f72c2b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.695755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe7608-dbd3-4a49-89c8-ce78f72c2b1a admin admin] PATH_INFO: `/v3/projects/e9a551687bb64046836905e87ed5d4da/users/7c3642da04e04e668e1ce344309f2013/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:58.698347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:58.756872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 870/1753] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:25:58.757946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:58.760629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:58.776138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe7608-dbd3-4a49-89c8-ce78f72c2b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a551687bb64046836905e87ed5d4da, user_id=7c3642da04e04e668e1ce344309f2013, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:58.779082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe7608-dbd3-4a49-89c8-ce78f72c2b1a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:58.794683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac1fe2-2798-47f5-ba7c-d06c9f1f9bdd admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:58.798762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5f551-9892-42e7-a746-6a8f0549606b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:58.799470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5f551-9892-42e7-a746-6a8f0549606b service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.799756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5f551-9892-42e7-a746-6a8f0549606b service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.800068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5f551-9892-42e7-a746-6a8f0549606b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:58.829699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5f551-9892-42e7-a746-6a8f0549606b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:58.837211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 884/1754] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:25:58 2022] PUT /identity/v3/projects/e9a551687bb64046836905e87ed5d4da/users/7c3642da04e04e668e1ce344309f2013/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:25:58.838233 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe7608-dbd3-4a49-89c8-ce78f72c2b1a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:58.839119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5f551-9892-42e7-a746-6a8f0549606b service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:58.891316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 871/1755] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:25:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:25:58.896935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f3520-79f8-4793-842f-64e874233eb9 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:58.897589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f3520-79f8-4793-842f-64e874233eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:58.898153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f3520-79f8-4793-842f-64e874233eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:59.089217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-620f3520-79f8-4793-842f-64e874233eb9 None None] MFA Rules not processed for user `7c3642da04e04e668e1ce344309f2013`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:59.092108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-620f3520-79f8-4793-842f-64e874233eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:25:59.177475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe7608-dbd3-4a49-89c8-ce78f72c2b1a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:59.209544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8718-2958-4ced-84ac-a223f27f1ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:59.210333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8718-2958-4ced-84ac-a223f27f1ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:59.210500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8718-2958-4ced-84ac-a223f27f1ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:59.210853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8718-2958-4ced-84ac-a223f27f1ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:59.211405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f8718-2958-4ced-84ac-a223f27f1ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:59.213425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f8718-2958-4ced-84ac-a223f27f1ecf admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:59.336246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 885/1756] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:58 2022] POST /identity/v3/projects => generated 385 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:59.340401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8718-2958-4ced-84ac-a223f27f1ecf admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:59.364720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:25:59.474847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 872/1757] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:25:59.482341 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f3520-79f8-4793-842f-64e874233eb9 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:59.540068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f3520-79f8-4793-842f-64e874233eb9 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:59.587960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8718-2958-4ced-84ac-a223f27f1ecf admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:59.615290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb186eb6-0e48-450a-a73b-edc63196458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:59.615965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb186eb6-0e48-450a-a73b-edc63196458a admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:59.619311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb186eb6-0e48-450a-a73b-edc63196458a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:59.619626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb186eb6-0e48-450a-a73b-edc63196458a admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:59.625830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb186eb6-0e48-450a-a73b-edc63196458a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:59.648489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb186eb6-0e48-450a-a73b-edc63196458a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:59.751666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a5bef-616e-4eaa-b349-1ec7931a59d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:59.752419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a5bef-616e-4eaa-b349-1ec7931a59d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:59.752930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a5bef-616e-4eaa-b349-1ec7931a59d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:59.753590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a5bef-616e-4eaa-b349-1ec7931a59d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:59.756439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 886/1758] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:59 2022] POST /identity/v3/users => generated 293 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:25:59.756579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a5bef-616e-4eaa-b349-1ec7931a59d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:59.759557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a5bef-616e-4eaa-b349-1ec7931a59d2 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:59.772090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb186eb6-0e48-450a-a73b-edc63196458a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:59.805366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb186eb6-0e48-450a-a73b-edc63196458a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:25:59.824027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d373be-2752-49a3-8af7-398bbea929ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:25:59.825616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d373be-2752-49a3-8af7-398bbea929ec admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:59.826062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d373be-2752-49a3-8af7-398bbea929ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:59.826646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d373be-2752-49a3-8af7-398bbea929ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:59.827447 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d373be-2752-49a3-8af7-398bbea929ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:25:59.829219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d373be-2752-49a3-8af7-398bbea929ec admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:25:59.832515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 873/1759] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:25:59 2022] POST /identity/v3/projects => generated 387 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:25:59.844937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a5bef-616e-4eaa-b349-1ec7931a59d2 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:25:59.868728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 887/1760] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:25:59.870520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260bac0-e9dc-4512-9e6a-9fd374840fdc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:25:59.871080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260bac0-e9dc-4512-9e6a-9fd374840fdc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:25:59.871512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260bac0-e9dc-4512-9e6a-9fd374840fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:25:59.954979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6260bac0-e9dc-4512-9e6a-9fd374840fdc None None] MFA Rules not processed for user `36d7b059ff874d0db44ceecb2f95830c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:25:59.977035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6260bac0-e9dc-4512-9e6a-9fd374840fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:00.155909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:00.198157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a5bef-616e-4eaa-b349-1ec7931a59d2 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:00.224920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cec47-80d2-4877-9660-cfe9e08c333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:00.228245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cec47-80d2-4877-9660-cfe9e08c333d admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:00.235131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cec47-80d2-4877-9660-cfe9e08c333d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:00.236554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cec47-80d2-4877-9660-cfe9e08c333d admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:00.239601 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cec47-80d2-4877-9660-cfe9e08c333d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:00.251584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cec47-80d2-4877-9660-cfe9e08c333d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:00.281208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 888/1761] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:25:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:00.289259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260bac0-e9dc-4512-9e6a-9fd374840fdc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:00.327784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260bac0-e9dc-4512-9e6a-9fd374840fdc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:00.335578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54355944-9604-4742-aed3-e5a00c660ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:00.338845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 874/1762] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:25:59 2022] POST /identity/v3/users => generated 300 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:00.343108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cec47-80d2-4877-9660-cfe9e08c333d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:00.347915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54355944-9604-4742-aed3-e5a00c660ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:00.348992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54355944-9604-4742-aed3-e5a00c660ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:00.350655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54355944-9604-4742-aed3-e5a00c660ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:00.352451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54355944-9604-4742-aed3-e5a00c660ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:00.356659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54355944-9604-4742-aed3-e5a00c660ce3 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:00.372207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cec47-80d2-4877-9660-cfe9e08c333d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:00.389200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d62e50-d6c8-48aa-850a-5f2ef1efbb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:00.389777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d62e50-d6c8-48aa-850a-5f2ef1efbb4f admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:00.390014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d62e50-d6c8-48aa-850a-5f2ef1efbb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:00.390355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d62e50-d6c8-48aa-850a-5f2ef1efbb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:00.390955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d62e50-d6c8-48aa-850a-5f2ef1efbb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:00.399440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d62e50-d6c8-48aa-850a-5f2ef1efbb4f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:00.429283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 875/1763] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:00.431311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d62e50-d6c8-48aa-850a-5f2ef1efbb4f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:00.431938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 889/1764] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:00.444322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54355944-9604-4742-aed3-e5a00c660ce3 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:00.476297 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d62e50-d6c8-48aa-850a-5f2ef1efbb4f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:00.502867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d57a7-6060-4559-9303-10ff816f45c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:00.504615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d57a7-6060-4559-9303-10ff816f45c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:00.504899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d57a7-6060-4559-9303-10ff816f45c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:00.505179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d57a7-6060-4559-9303-10ff816f45c3 admin admin] PATH_INFO: `/v3/projects/9ac0a25e322644429e7375ed6a05289e/users/552bd1f9e5614127b560456bdc4232c8/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:00.509990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54355944-9604-4742-aed3-e5a00c660ce3 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:00.540865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dd1ee-8d4e-4cbe-a4f9-90f9d5501da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:00.544567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dd1ee-8d4e-4cbe-a4f9-90f9d5501da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:00.547873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dd1ee-8d4e-4cbe-a4f9-90f9d5501da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:00.548763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dd1ee-8d4e-4cbe-a4f9-90f9d5501da3 admin admin] PATH_INFO: `/v3/projects/2cc9a0c570fa4beb96aeaedabb163dec/users/b0c76e2f44684c078d0208b4e822f4ca/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:00.562696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d57a7-6060-4559-9303-10ff816f45c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac0a25e322644429e7375ed6a05289e, user_id=552bd1f9e5614127b560456bdc4232c8, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:00.583234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d57a7-6060-4559-9303-10ff816f45c3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:00.627164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 876/1765] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:00 2022] PUT /identity/v3/projects/9ac0a25e322644429e7375ed6a05289e/users/552bd1f9e5614127b560456bdc4232c8/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:00.631504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d57a7-6060-4559-9303-10ff816f45c3 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:00.637311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dd1ee-8d4e-4cbe-a4f9-90f9d5501da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc9a0c570fa4beb96aeaedabb163dec, user_id=b0c76e2f44684c078d0208b4e822f4ca, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:00.645281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dd1ee-8d4e-4cbe-a4f9-90f9d5501da3 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:00.686381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 890/1766] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:00 2022] PUT /identity/v3/projects/2cc9a0c570fa4beb96aeaedabb163dec/users/b0c76e2f44684c078d0208b4e822f4ca/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:00.698068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706182-20c3-402b-b3cf-835cdab25028 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:00.698704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706182-20c3-402b-b3cf-835cdab25028 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:00.699155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706182-20c3-402b-b3cf-835cdab25028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:00.743872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:00.812063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-bb706182-20c3-402b-b3cf-835cdab25028 None None] MFA Rules not processed for user `b0c76e2f44684c078d0208b4e822f4ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:00.823023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bb706182-20c3-402b-b3cf-835cdab25028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:00.836136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d57a7-6060-4559-9303-10ff816f45c3 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:01.018000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e5703-2830-4230-a288-f615f87aa162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:01.022128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e5703-2830-4230-a288-f615f87aa162 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:01.022538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e5703-2830-4230-a288-f615f87aa162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:01.023180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e5703-2830-4230-a288-f615f87aa162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:01.024406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e5703-2830-4230-a288-f615f87aa162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:01.026913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e5703-2830-4230-a288-f615f87aa162 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:01.064605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 877/1767] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:01.070685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e5703-2830-4230-a288-f615f87aa162 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:01.092375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 891/1768] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:01.099413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb706182-20c3-402b-b3cf-835cdab25028 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:01.109226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e5703-2830-4230-a288-f615f87aa162 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:01.110038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bb706182-20c3-402b-b3cf-835cdab25028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:01.138150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e073e-abb1-4cec-981c-a7531ab699ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:01.138858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e073e-abb1-4cec-981c-a7531ab699ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:01.139147 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e073e-abb1-4cec-981c-a7531ab699ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:01.139430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e073e-abb1-4cec-981c-a7531ab699ac admin admin] PATH_INFO: `/v3/projects/9ac0a25e322644429e7375ed6a05289e/users/552bd1f9e5614127b560456bdc4232c8/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:01.145200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e073e-abb1-4cec-981c-a7531ab699ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac0a25e322644429e7375ed6a05289e, user_id=552bd1f9e5614127b560456bdc4232c8, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:01.149954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e073e-abb1-4cec-981c-a7531ab699ac admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:01.192187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 878/1769] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:01 2022] PUT /identity/v3/projects/9ac0a25e322644429e7375ed6a05289e/users/552bd1f9e5614127b560456bdc4232c8/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:01.203543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830826c-031d-43c9-b4c6-93a40ed91095 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:01.204148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830826c-031d-43c9-b4c6-93a40ed91095 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:01.204578 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830826c-031d-43c9-b4c6-93a40ed91095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:01.308514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8830826c-031d-43c9-b4c6-93a40ed91095 None None] MFA Rules not processed for user `552bd1f9e5614127b560456bdc4232c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:01.310045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8830826c-031d-43c9-b4c6-93a40ed91095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:01.387731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb706182-20c3-402b-b3cf-835cdab25028 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:01.588407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:01.641451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 879/1770] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:01.644855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28350f-7330-422e-b392-74fcf1865aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:01.646949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28350f-7330-422e-b392-74fcf1865aad service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:01.647906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28350f-7330-422e-b392-74fcf1865aad service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:01.649873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28350f-7330-422e-b392-74fcf1865aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:01.698296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830826c-031d-43c9-b4c6-93a40ed91095 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:01.700549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8830826c-031d-43c9-b4c6-93a40ed91095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:01.735589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830826c-031d-43c9-b4c6-93a40ed91095 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:01.745248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2986033-42a4-48e9-9a84-6aa65e8d640a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:01.747374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2986033-42a4-48e9-9a84-6aa65e8d640a service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:01.748421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2986033-42a4-48e9-9a84-6aa65e8d640a service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:01.749158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2986033-42a4-48e9-9a84-6aa65e8d640a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:01.773556 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2986033-42a4-48e9-9a84-6aa65e8d640a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:01.778084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2986033-42a4-48e9-9a84-6aa65e8d640a service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:01.805647 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 880/1771] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:01.906616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2986033-42a4-48e9-9a84-6aa65e8d640a service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:01.939652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28350f-7330-422e-b392-74fcf1865aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:01.944680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28350f-7330-422e-b392-74fcf1865aad service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:01.968888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:01.988909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 892/1772] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 890 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:02.015146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28350f-7330-422e-b392-74fcf1865aad service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:02.162607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2986033-42a4-48e9-9a84-6aa65e8d640a service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:02.191885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:02.201298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:02.202248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:02.202548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] PATH_INFO: `/v3/users/7c3642da04e04e668e1ce344309f2013` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:02.205825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3642da04e04e668e1ce344309f2013)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:02.221360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:02.318131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28350f-7330-422e-b392-74fcf1865aad service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:02.345411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:02.347513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:02.348077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:02.349617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] PATH_INFO: `/v3/users/b0c76e2f44684c078d0208b4e822f4ca` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:02.356603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c76e2f44684c078d0208b4e822f4ca)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:02.359202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:02.392484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3642da04e04e668e1ce344309f2013'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.430534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3642da04e04e668e1ce344309f2013'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.436233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3642da04e04e668e1ce344309f2013'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.495946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3642da04e04e668e1ce344309f2013'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.506028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-10a65ed0-ffdd-4e98-961b-a43140055d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3642da04e04e668e1ce344309f2013'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.507946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c76e2f44684c078d0208b4e822f4ca'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.517730 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 881/1773] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:01 2022] DELETE /identity/v3/users/7c3642da04e04e668e1ce344309f2013 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:02.518585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00917b-46a1-4d1c-bf68-a2d27442fb68 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:02.519528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00917b-46a1-4d1c-bf68-a2d27442fb68 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:02.519881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00917b-46a1-4d1c-bf68-a2d27442fb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:02.544375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c76e2f44684c078d0208b4e822f4ca'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.559206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c76e2f44684c078d0208b4e822f4ca'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.576437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-bf00917b-46a1-4d1c-bf68-a2d27442fb68 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:02.578059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-bf00917b-46a1-4d1c-bf68-a2d27442fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:02.589986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c76e2f44684c078d0208b4e822f4ca'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.608987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd409fdc-b925-415d-8737-f748ab636b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c76e2f44684c078d0208b4e822f4ca'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:02.624172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 893/1774] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:02 2022] DELETE /identity/v3/users/b0c76e2f44684c078d0208b4e822f4ca => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:02.631543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5add2-84ea-484d-9843-80be5e3d15ad None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:02.631837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5add2-84ea-484d-9843-80be5e3d15ad None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:02.632121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5add2-84ea-484d-9843-80be5e3d15ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:02.678127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-91c5add2-84ea-484d-9843-80be5e3d15ad None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:02.684814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-91c5add2-84ea-484d-9843-80be5e3d15ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:02.742586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:02.809046 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 882/1775] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:02.930841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00917b-46a1-4d1c-bf68-a2d27442fb68 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:02.933259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-bf00917b-46a1-4d1c-bf68-a2d27442fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:02.945163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 894/1776] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:02.966579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5add2-84ea-484d-9843-80be5e3d15ad None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:02.973958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00917b-46a1-4d1c-bf68-a2d27442fb68 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:02.975020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-91c5add2-84ea-484d-9843-80be5e3d15ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:03.005138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:03.005844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:03.006387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:03.006758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] PATH_INFO: `/v3/projects/90bfad88c6d547baaf18c7da739c703b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:03.013839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bfad88c6d547baaf18c7da739c703b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:03.024723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:03.112413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5add2-84ea-484d-9843-80be5e3d15ad None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:03.116811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d883b-e07e-46a4-866e-50207e44b66c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:03.117861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d883b-e07e-46a4-866e-50207e44b66c service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:03.118343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d883b-e07e-46a4-866e-50207e44b66c service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:03.118825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d883b-e07e-46a4-866e-50207e44b66c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:03.132498 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d883b-e07e-46a4-866e-50207e44b66c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:03.135385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d883b-e07e-46a4-866e-50207e44b66c service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:03.150662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 895/1777] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:03.151927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d883b-e07e-46a4-866e-50207e44b66c service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:03.157148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:03.164011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d883b-e07e-46a4-866e-50207e44b66c service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:03.205376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bfad88c6d547baaf18c7da739c703b', 'request_id': 'req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:03.228583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bfad88c6d547baaf18c7da739c703b', 'request_id': 'req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:03.277550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bfad88c6d547baaf18c7da739c703b', 'request_id': 'req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:03.338720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] The token cache is being invalidate because project 90bfad88c6d547baaf18c7da739c703b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:03.339034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:03.339763 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab32f240-0e44-4c0a-ab04-c8ce0dd97bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:03.350503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 883/1778] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:02 2022] DELETE /identity/v3/projects/90bfad88c6d547baaf18c7da739c703b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:03.359328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b68dc-74d8-494b-82ad-84fe05e9029f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:03.359665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b68dc-74d8-494b-82ad-84fe05e9029f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:03.360062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b68dc-74d8-494b-82ad-84fe05e9029f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:03.419049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3b3b68dc-74d8-494b-82ad-84fe05e9029f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:03.421371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3b3b68dc-74d8-494b-82ad-84fe05e9029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:03.507799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5cf55-e762-4172-82c9-b7f5457b1d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:03.507799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5cf55-e762-4172-82c9-b7f5457b1d83 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:03.507799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5cf55-e762-4172-82c9-b7f5457b1d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:03.507799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5cf55-e762-4172-82c9-b7f5457b1d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:03.519469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-66d5cf55-e762-4172-82c9-b7f5457b1d83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:03.750308 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 884/1779] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:03.757302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed4600-8e76-4256-b6bd-6f53b022706a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:03.757668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed4600-8e76-4256-b6bd-6f53b022706a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:03.757932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed4600-8e76-4256-b6bd-6f53b022706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:03.822325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5cf55-e762-4172-82c9-b7f5457b1d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:03.830818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5cf55-e762-4172-82c9-b7f5457b1d83 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:03.843286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-92ed4600-8e76-4256-b6bd-6f53b022706a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:03.844523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-92ed4600-8e76-4256-b6bd-6f53b022706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:03.865024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 896/1780] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:03.874687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 885/1781] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:03.875093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5cf55-e762-4172-82c9-b7f5457b1d83 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:03.910265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5cf55-e762-4172-82c9-b7f5457b1d83 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:03.926077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba879f07-f70d-4fc7-9069-79fd49dadc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:03.926880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba879f07-f70d-4fc7-9069-79fd49dadc38 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:03.927166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba879f07-f70d-4fc7-9069-79fd49dadc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:03.927536 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba879f07-f70d-4fc7-9069-79fd49dadc38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:03.928203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba879f07-f70d-4fc7-9069-79fd49dadc38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:03.928517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba879f07-f70d-4fc7-9069-79fd49dadc38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:03.942944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba879f07-f70d-4fc7-9069-79fd49dadc38 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:03.947319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:03.992381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 897/1782] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:26:03.995569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed4600-8e76-4256-b6bd-6f53b022706a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:04.017892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed4600-8e76-4256-b6bd-6f53b022706a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:04.034171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1867b69-eae7-4d29-a263-f10962938cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:04.034812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1867b69-eae7-4d29-a263-f10962938cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:04.043639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1867b69-eae7-4d29-a263-f10962938cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:04.043954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1867b69-eae7-4d29-a263-f10962938cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:04.044657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1867b69-eae7-4d29-a263-f10962938cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:04.046627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1867b69-eae7-4d29-a263-f10962938cb4 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:04.209139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 886/1783] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:03 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:04.209585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba879f07-f70d-4fc7-9069-79fd49dadc38 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:04.232014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba879f07-f70d-4fc7-9069-79fd49dadc38 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:04.506183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1414f3-cf37-41bd-af92-c8c0cf0b0700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:04.507159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1414f3-cf37-41bd-af92-c8c0cf0b0700 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:04.507453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1414f3-cf37-41bd-af92-c8c0cf0b0700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:04.507987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1414f3-cf37-41bd-af92-c8c0cf0b0700 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:04.510344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1414f3-cf37-41bd-af92-c8c0cf0b0700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:04.532652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1414f3-cf37-41bd-af92-c8c0cf0b0700 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:04.598916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 898/1784] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:04 2022] POST /identity/v3/users => generated 291 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:04.600987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1867b69-eae7-4d29-a263-f10962938cb4 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:04.619548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1867b69-eae7-4d29-a263-f10962938cb4 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:04.643275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97abd5-b5b1-410e-bd17-55603a2394fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:04.645905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97abd5-b5b1-410e-bd17-55603a2394fa admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:04.648534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97abd5-b5b1-410e-bd17-55603a2394fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:04.650827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97abd5-b5b1-410e-bd17-55603a2394fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:04.657597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97abd5-b5b1-410e-bd17-55603a2394fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:04.665093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97abd5-b5b1-410e-bd17-55603a2394fa admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:04.726546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 887/1785] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:04.729923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1414f3-cf37-41bd-af92-c8c0cf0b0700 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:04.752513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1414f3-cf37-41bd-af92-c8c0cf0b0700 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:04.772291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dade1a-71ba-416a-8dbc-421f24426301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:04.773374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dade1a-71ba-416a-8dbc-421f24426301 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:04.774163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dade1a-71ba-416a-8dbc-421f24426301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:04.774770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dade1a-71ba-416a-8dbc-421f24426301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:04.775880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dade1a-71ba-416a-8dbc-421f24426301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:04.785018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dade1a-71ba-416a-8dbc-421f24426301 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:04.807607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 899/1786] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:04.812536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97abd5-b5b1-410e-bd17-55603a2394fa admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:04.833216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97abd5-b5b1-410e-bd17-55603a2394fa admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:04.845890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0320e-cbf5-4cd8-b9a9-3c3a4196b84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:04.846587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0320e-cbf5-4cd8-b9a9-3c3a4196b84b admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:04.846841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0320e-cbf5-4cd8-b9a9-3c3a4196b84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:04.847043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0320e-cbf5-4cd8-b9a9-3c3a4196b84b admin admin] PATH_INFO: `/v3/projects/05eb5cd0674944bbae0d637e2e56233b/users/f564ceebad7f47558926965e396bf10d/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:04.885764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0320e-cbf5-4cd8-b9a9-3c3a4196b84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eb5cd0674944bbae0d637e2e56233b, user_id=f564ceebad7f47558926965e396bf10d, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:04.887074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0320e-cbf5-4cd8-b9a9-3c3a4196b84b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:04.914765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 888/1787] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:04 2022] PUT /identity/v3/projects/05eb5cd0674944bbae0d637e2e56233b/users/f564ceebad7f47558926965e396bf10d/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:04.931697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2246c9b-889d-469b-8146-832aa07ebe32 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:04.933923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2246c9b-889d-469b-8146-832aa07ebe32 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:04.934740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2246c9b-889d-469b-8146-832aa07ebe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:05.066392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c2246c9b-889d-469b-8146-832aa07ebe32 None None] MFA Rules not processed for user `f564ceebad7f47558926965e396bf10d`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:05.071743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c2246c9b-889d-469b-8146-832aa07ebe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:05.255131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafab6-80f2-43e8-8588-fd78e459c54d None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:05.255949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafab6-80f2-43e8-8588-fd78e459c54d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:05.256241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafab6-80f2-43e8-8588-fd78e459c54d None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:05.277440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 889/1788] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:26:05 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:26:05.304805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 900/1789] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:05.310070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaafab6-80f2-43e8-8588-fd78e459c54d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:05.466004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d92e0-02f1-4a2e-b6f9-9fdb5f397e5e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:05.467000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d92e0-02f1-4a2e-b6f9-9fdb5f397e5e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:05.467370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d92e0-02f1-4a2e-b6f9-9fdb5f397e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:05.490939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaafab6-80f2-43e8-8588-fd78e459c54d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:05.501250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f6d4d-e761-4390-9f28-cf6a391bc64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:05.501900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f6d4d-e761-4390-9f28-cf6a391bc64f admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:05.502184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f6d4d-e761-4390-9f28-cf6a391bc64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:05.502460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f6d4d-e761-4390-9f28-cf6a391bc64f admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:05.503669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f6d4d-e761-4390-9f28-cf6a391bc64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:05.505641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f6d4d-e761-4390-9f28-cf6a391bc64f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:05.538448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-598d92e0-02f1-4a2e-b6f9-9fdb5f397e5e None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:05.540955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:05.543291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-598d92e0-02f1-4a2e-b6f9-9fdb5f397e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:05.577164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 890/1790] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:05 2022] POST /identity/v3/projects => generated 379 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:05.581223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f6d4d-e761-4390-9f28-cf6a391bc64f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:05.707624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:05.772641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f6d4d-e761-4390-9f28-cf6a391bc64f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:05.773680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 901/1791] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:26:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:05.795632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78285-976b-4705-a24e-73a2cbd248d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:05.796400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78285-976b-4705-a24e-73a2cbd248d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:05.796692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78285-976b-4705-a24e-73a2cbd248d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:05.796978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78285-976b-4705-a24e-73a2cbd248d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:05.797677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e78285-976b-4705-a24e-73a2cbd248d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:05.804130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e78285-976b-4705-a24e-73a2cbd248d5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:05.855078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 891/1792] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:05 2022] POST /identity/v3/users => generated 296 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:05.859096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d92e0-02f1-4a2e-b6f9-9fdb5f397e5e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:05.879401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d92e0-02f1-4a2e-b6f9-9fdb5f397e5e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:05.922186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7e552-713b-46c0-a1c9-69776519fdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:05.922831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e552-713b-46c0-a1c9-69776519fdfc admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:05.923119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e552-713b-46c0-a1c9-69776519fdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:05.923396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e552-713b-46c0-a1c9-69776519fdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:05.924549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7e552-713b-46c0-a1c9-69776519fdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:05.937134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7e552-713b-46c0-a1c9-69776519fdfc admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:05.959971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 902/1793] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:05.964254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78285-976b-4705-a24e-73a2cbd248d5 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:05.981637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78285-976b-4705-a24e-73a2cbd248d5 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:06.002675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7e522-dd99-4f20-ad06-1e72fb89fb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:06.003443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7e522-dd99-4f20-ad06-1e72fb89fb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:06.003726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7e522-dd99-4f20-ad06-1e72fb89fb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:06.004006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7e522-dd99-4f20-ad06-1e72fb89fb43 admin admin] PATH_INFO: `/v3/projects/e985f43035a94ea9ada5f34a05a64b0a/users/77a66ab9478f4618b0c13831151a8f56/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:06.098576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7e522-dd99-4f20-ad06-1e72fb89fb43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e985f43035a94ea9ada5f34a05a64b0a, user_id=77a66ab9478f4618b0c13831151a8f56, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:06.101346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7e522-dd99-4f20-ad06-1e72fb89fb43 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:06.166050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 892/1794] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:05 2022] PUT /identity/v3/projects/e985f43035a94ea9ada5f34a05a64b0a/users/77a66ab9478f4618b0c13831151a8f56/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:06.170505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7e552-713b-46c0-a1c9-69776519fdfc admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:06.195974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7e552-713b-46c0-a1c9-69776519fdfc admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:06.402287 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403d2e5-2e1b-419a-b1b6-76bfd94e580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:06.402942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403d2e5-2e1b-419a-b1b6-76bfd94e580f admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:06.403281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403d2e5-2e1b-419a-b1b6-76bfd94e580f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:06.403537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403d2e5-2e1b-419a-b1b6-76bfd94e580f admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:06.404159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403d2e5-2e1b-419a-b1b6-76bfd94e580f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:06.414111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403d2e5-2e1b-419a-b1b6-76bfd94e580f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:06.481086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 903/1795] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:06.485827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7e522-dd99-4f20-ad06-1e72fb89fb43 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:06.499025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7e522-dd99-4f20-ad06-1e72fb89fb43 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:06.515899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e24cf4-0c11-455d-bc7b-acf0f18595c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:06.516590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e24cf4-0c11-455d-bc7b-acf0f18595c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:06.516877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e24cf4-0c11-455d-bc7b-acf0f18595c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:06.517318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e24cf4-0c11-455d-bc7b-acf0f18595c8 admin admin] PATH_INFO: `/v3/projects/e985f43035a94ea9ada5f34a05a64b0a/users/77a66ab9478f4618b0c13831151a8f56/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:06.533577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e24cf4-0c11-455d-bc7b-acf0f18595c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e985f43035a94ea9ada5f34a05a64b0a, user_id=77a66ab9478f4618b0c13831151a8f56, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:06.536829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e24cf4-0c11-455d-bc7b-acf0f18595c8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:06.595697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 893/1796] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:06 2022] PUT /identity/v3/projects/e985f43035a94ea9ada5f34a05a64b0a/users/77a66ab9478f4618b0c13831151a8f56/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:06.620201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f7232-7c86-497a-9b9e-db2886d57873 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:06.620591 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f7232-7c86-497a-9b9e-db2886d57873 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:06.620764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f7232-7c86-497a-9b9e-db2886d57873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:06.701788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-891f7232-7c86-497a-9b9e-db2886d57873 None None] MFA Rules not processed for user `77a66ab9478f4618b0c13831151a8f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:06.705379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-891f7232-7c86-497a-9b9e-db2886d57873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:06.983695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 904/1797] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:06.992142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e24cf4-0c11-455d-bc7b-acf0f18595c8 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:06.994436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d6e24cf4-0c11-455d-bc7b-acf0f18595c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:07.158664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e24cf4-0c11-455d-bc7b-acf0f18595c8 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:07.163388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b68abd-dd3f-4fbc-8b11-d0279ebacabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:07.164073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b68abd-dd3f-4fbc-8b11-d0279ebacabc service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:07.164361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b68abd-dd3f-4fbc-8b11-d0279ebacabc service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:07.164638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b68abd-dd3f-4fbc-8b11-d0279ebacabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:07.181784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f7232-7c86-497a-9b9e-db2886d57873 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:07.183456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-891f7232-7c86-497a-9b9e-db2886d57873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:07.189742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b68abd-dd3f-4fbc-8b11-d0279ebacabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:07.195718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b68abd-dd3f-4fbc-8b11-d0279ebacabc service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:07.228381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 894/1798] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:07.327669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b68abd-dd3f-4fbc-8b11-d0279ebacabc service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:07.329614 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e9b68abd-dd3f-4fbc-8b11-d0279ebacabc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:07.389065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:07.402070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f7232-7c86-497a-9b9e-db2886d57873 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:07.434808 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac4d91-a078-4403-9489-fc1d8a0a7ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:07.435454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac4d91-a078-4403-9489-fc1d8a0a7ec7 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:07.440078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac4d91-a078-4403-9489-fc1d8a0a7ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:07.440416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac4d91-a078-4403-9489-fc1d8a0a7ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:07.469823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac4d91-a078-4403-9489-fc1d8a0a7ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:07.475380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac4d91-a078-4403-9489-fc1d8a0a7ec7 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:07.480322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:07.502568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 905/1799] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:07.566134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b68abd-dd3f-4fbc-8b11-d0279ebacabc service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:07.581770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:07.583014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:07.583465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:07.583900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] PATH_INFO: `/v3/projects/e9a551687bb64046836905e87ed5d4da` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:07.586501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a551687bb64046836905e87ed5d4da)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:07.594271 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:07.766045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a551687bb64046836905e87ed5d4da', 'request_id': 'req-8827b44d-9e5c-4eb2-8983-16503a35b6c9'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:07.777633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a551687bb64046836905e87ed5d4da', 'request_id': 'req-8827b44d-9e5c-4eb2-8983-16503a35b6c9'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:07.787394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a551687bb64046836905e87ed5d4da', 'request_id': 'req-8827b44d-9e5c-4eb2-8983-16503a35b6c9'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:07.806383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] The token cache is being invalidate because project e9a551687bb64046836905e87ed5d4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:07.806979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:07.807849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:07.809684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 895/1800] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:07 2022] DELETE /identity/v3/projects/e9a551687bb64046836905e87ed5d4da => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:07.814889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac4d91-a078-4403-9489-fc1d8a0a7ec7 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:07.838458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac4d91-a078-4403-9489-fc1d8a0a7ec7 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:07.938860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:07.940177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:07.947668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:07.948191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] PATH_INFO: `/v3/users/552bd1f9e5614127b560456bdc4232c8` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:07.949785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=552bd1f9e5614127b560456bdc4232c8)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:07.952128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:08.006054 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:08.008466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:08.033816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552bd1f9e5614127b560456bdc4232c8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.045828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552bd1f9e5614127b560456bdc4232c8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.047504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552bd1f9e5614127b560456bdc4232c8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.065793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552bd1f9e5614127b560456bdc4232c8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.080494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552bd1f9e5614127b560456bdc4232c8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.091284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 906/1801] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:07 2022] DELETE /identity/v3/users/552bd1f9e5614127b560456bdc4232c8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:08.123692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:08.126056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:08.171796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827b44d-9e5c-4eb2-8983-16503a35b6c9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:08.279831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacad9e0-2aca-4803-9fc2-80849d1e78bf admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:08.287235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:08.289071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.289835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.290365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] PATH_INFO: `/v3/projects/2cc9a0c570fa4beb96aeaedabb163dec` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.291748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc9a0c570fa4beb96aeaedabb163dec)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:08.295093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:08.310822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:08.320241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a66ab9478f4618b0c13831151a8f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e985f43035a94ea9ada5f34a05a64b0a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:08.320578 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.320907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.322533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.324129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:08.324804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:08.328626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:08.344117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 896/1802] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:08.350500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:08.354013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:08.370457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc9a0c570fa4beb96aeaedabb163dec', 'request_id': 'req-7426528c-848c-4585-9342-5ddf7fae123d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.371305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b246a-d7c3-460e-a80c-26b6c5f5c9d5 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:08.388215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc9a0c570fa4beb96aeaedabb163dec', 'request_id': 'req-7426528c-848c-4585-9342-5ddf7fae123d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.405373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:08.407355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc9a0c570fa4beb96aeaedabb163dec', 'request_id': 'req-7426528c-848c-4585-9342-5ddf7fae123d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.446810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] The token cache is being invalidate because project 2cc9a0c570fa4beb96aeaedabb163dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:08.447115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.447853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7426528c-848c-4585-9342-5ddf7fae123d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.449756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 907/1803] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:08 2022] DELETE /identity/v3/projects/2cc9a0c570fa4beb96aeaedabb163dec => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:08.454192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d941a-9947-4871-8122-178900f35057 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.454562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d941a-9947-4871-8122-178900f35057 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.454974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d941a-9947-4871-8122-178900f35057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.477962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-a85d941a-9947-4871-8122-178900f35057 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:08.479331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a85d941a-9947-4871-8122-178900f35057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:08.480564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232b47b-984c-4ecb-9873-36ca0538b9da tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a66ab9478f4618b0c13831151a8f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e985f43035a94ea9ada5f34a05a64b0a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:08.481107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232b47b-984c-4ecb-9873-36ca0538b9da tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.481488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232b47b-984c-4ecb-9873-36ca0538b9da tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.481889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232b47b-984c-4ecb-9873-36ca0538b9da tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.482791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232b47b-984c-4ecb-9873-36ca0538b9da tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:08.485487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232b47b-984c-4ecb-9873-36ca0538b9da tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:08.552128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 897/1804] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:08 2022] POST /identity/v3/projects => generated 354 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:08.554422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ca9e4-2232-4c6f-9add-e222a2f734ab None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.555666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ca9e4-2232-4c6f-9add-e222a2f734ab None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.559692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ca9e4-2232-4c6f-9add-e222a2f734ab None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.561338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 898/1805] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:26:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:26:08.564089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ca9e4-2232-4c6f-9add-e222a2f734ab None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:08.566311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ce6ca9e4-2232-4c6f-9add-e222a2f734ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:08.584896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 908/1806] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:08.586547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebee14b-0d12-4c92-b1ed-450fb8aabdc9 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.586941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebee14b-0d12-4c92-b1ed-450fb8aabdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.587323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebee14b-0d12-4c92-b1ed-450fb8aabdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.615398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-cebee14b-0d12-4c92-b1ed-450fb8aabdc9 None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:08.616836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-cebee14b-0d12-4c92-b1ed-450fb8aabdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:08.701592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ca9e4-2232-4c6f-9add-e222a2f734ab None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:08.708231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f68544-de84-4f7f-ba7b-df5a218f72e0 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a66ab9478f4618b0c13831151a8f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e985f43035a94ea9ada5f34a05a64b0a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:08.709048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f68544-de84-4f7f-ba7b-df5a218f72e0 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.709376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f68544-de84-4f7f-ba7b-df5a218f72e0 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.709657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f68544-de84-4f7f-ba7b-df5a218f72e0 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.710536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f68544-de84-4f7f-ba7b-df5a218f72e0 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:08.710853 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f68544-de84-4f7f-ba7b-df5a218f72e0 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:08.714308 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f68544-de84-4f7f-ba7b-df5a218f72e0 tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:08.736897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 899/1807] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:08.739007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd41b29-00e7-48cf-abd9-69c8b3ac15f9 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.739538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd41b29-00e7-48cf-abd9-69c8b3ac15f9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.740052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd41b29-00e7-48cf-abd9-69c8b3ac15f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.766164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2dd41b29-00e7-48cf-abd9-69c8b3ac15f9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:08.767650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2dd41b29-00e7-48cf-abd9-69c8b3ac15f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:08.769743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 909/1808] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:26:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:08.770829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebee14b-0d12-4c92-b1ed-450fb8aabdc9 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:08.772362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-cebee14b-0d12-4c92-b1ed-450fb8aabdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:08.864055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:08.892961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 900/1809] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:08.892961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd41b29-00e7-48cf-abd9-69c8b3ac15f9 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:08.892961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2dd41b29-00e7-48cf-abd9-69c8b3ac15f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:08.910339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd41b29-00e7-48cf-abd9-69c8b3ac15f9 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:08.915638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebee14b-0d12-4c92-b1ed-450fb8aabdc9 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:08.921324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:08.921813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63fbb6-6797-4b72-90d7-647ff90262b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:08.921954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.922163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.922439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] PATH_INFO: `/v3/projects/9ac0a25e322644429e7375ed6a05289e` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.922549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63fbb6-6797-4b72-90d7-647ff90262b1 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.922893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63fbb6-6797-4b72-90d7-647ff90262b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.923012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63fbb6-6797-4b72-90d7-647ff90262b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.923589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac0a25e322644429e7375ed6a05289e)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:08.925615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:08.932623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63fbb6-6797-4b72-90d7-647ff90262b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:08.934247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63fbb6-6797-4b72-90d7-647ff90262b1 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:08.947245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 901/1810] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:08.948051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63fbb6-6797-4b72-90d7-647ff90262b1 service nova] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:08.959230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63fbb6-6797-4b72-90d7-647ff90262b1 service nova] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:08.964309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a66ab9478f4618b0c13831151a8f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e985f43035a94ea9ada5f34a05a64b0a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:08.964955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:08.965279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:08.965613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] PATH_INFO: `/v3/projects/7eae700fac234a109cd3c1ac54c13927` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:08.966729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7eae700fac234a109cd3c1ac54c13927)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:08.968680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:08.980599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac0a25e322644429e7375ed6a05289e', 'request_id': 'req-699ab463-40be-44a8-bb7f-7132aa1a2815'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.992202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac0a25e322644429e7375ed6a05289e', 'request_id': 'req-699ab463-40be-44a8-bb7f-7132aa1a2815'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:08.995941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:09.002334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac0a25e322644429e7375ed6a05289e', 'request_id': 'req-699ab463-40be-44a8-bb7f-7132aa1a2815'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.016389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] The token cache is being invalidate because project 9ac0a25e322644429e7375ed6a05289e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:09.016685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.017468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.020038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 910/1811] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:08 2022] DELETE /identity/v3/projects/9ac0a25e322644429e7375ed6a05289e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:09.024171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.025563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:09.033527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eae700fac234a109cd3c1ac54c13927', 'request_id': 'req-d275bffc-adb3-4850-8da7-3aaf76d54dec'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.040704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eae700fac234a109cd3c1ac54c13927', 'request_id': 'req-d275bffc-adb3-4850-8da7-3aaf76d54dec'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.046798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eae700fac234a109cd3c1ac54c13927', 'request_id': 'req-d275bffc-adb3-4850-8da7-3aaf76d54dec'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.063295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] The token cache is being invalidate because project 7eae700fac234a109cd3c1ac54c13927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:09.063585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.064374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d275bffc-adb3-4850-8da7-3aaf76d54dec tempest-VolumeQuotaClassesTest-771762080 tempest-VolumeQuotaClassesTest-771762080-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.066848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 902/1812] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:08 2022] DELETE /identity/v3/projects/7eae700fac234a109cd3c1ac54c13927 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:09.068205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777c58a-0b07-4ad5-a3a1-1d67c295c79b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.069142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777c58a-0b07-4ad5-a3a1-1d67c295c79b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.069142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777c58a-0b07-4ad5-a3a1-1d67c295c79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.091801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a777c58a-0b07-4ad5-a3a1-1d67c295c79b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:09.093708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a777c58a-0b07-4ad5-a3a1-1d67c295c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:09.101665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ab463-40be-44a8-bb7f-7132aa1a2815 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.180952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 903/1813] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:09.197414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfab25b-30c0-4221-a547-13e724681c0d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.197906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfab25b-30c0-4221-a547-13e724681c0d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.198555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfab25b-30c0-4221-a547-13e724681c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.207216 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.208245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.208609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.208957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.209970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:09.210346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.213291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.229610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1bfab25b-30c0-4221-a547-13e724681c0d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:09.233525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 911/1814] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:09.233709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1bfab25b-30c0-4221-a547-13e724681c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:09.235346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.239148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:09.247393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 904/1815] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:09.251077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:09.257860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad159a9-4e24-4eab-8881-ff955256ce98 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.261489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfab25b-30c0-4221-a547-13e724681c0d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.266255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69677ae-e86f-4c8b-9d1e-7eb230d22bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.267018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69677ae-e86f-4c8b-9d1e-7eb230d22bae admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.267491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69677ae-e86f-4c8b-9d1e-7eb230d22bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.267947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69677ae-e86f-4c8b-9d1e-7eb230d22bae admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.268789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69677ae-e86f-4c8b-9d1e-7eb230d22bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.271341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69677ae-e86f-4c8b-9d1e-7eb230d22bae admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.279693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfab25b-30c0-4221-a547-13e724681c0d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.285967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61addc-549c-40b8-8285-41c59b6e35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.287162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61addc-549c-40b8-8285-41c59b6e35bb admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.287635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61addc-549c-40b8-8285-41c59b6e35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.287919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61addc-549c-40b8-8285-41c59b6e35bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.288585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61addc-549c-40b8-8285-41c59b6e35bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:09.289049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61addc-549c-40b8-8285-41c59b6e35bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.291024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61addc-549c-40b8-8285-41c59b6e35bb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.309420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 905/1816] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:26:09.313708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61addc-549c-40b8-8285-41c59b6e35bb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.324034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 912/1817] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:09 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:09.331199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69677ae-e86f-4c8b-9d1e-7eb230d22bae admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.335763 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61addc-549c-40b8-8285-41c59b6e35bb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.407548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69677ae-e86f-4c8b-9d1e-7eb230d22bae admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.416811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc43bf-612e-4e57-8f5d-e608bcdc1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.417688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc43bf-612e-4e57-8f5d-e608bcdc1434 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.418588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc43bf-612e-4e57-8f5d-e608bcdc1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.419031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc43bf-612e-4e57-8f5d-e608bcdc1434 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.420369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc43bf-612e-4e57-8f5d-e608bcdc1434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.427060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc43bf-612e-4e57-8f5d-e608bcdc1434 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.468129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 913/1818] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:09 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:09.468129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc43bf-612e-4e57-8f5d-e608bcdc1434 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.470356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7ddc43bf-612e-4e57-8f5d-e608bcdc1434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:09.489317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc43bf-612e-4e57-8f5d-e608bcdc1434 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.494814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.495960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.496353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.496732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ae63-041a-44b6-a2ae-7c0af7c6c6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.497024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] PATH_INFO: `/v3/users/f564ceebad7f47558926965e396bf10d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.497707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ae63-041a-44b6-a2ae-7c0af7c6c6bf admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.497997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ae63-041a-44b6-a2ae-7c0af7c6c6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.498277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ae63-041a-44b6-a2ae-7c0af7c6c6bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.498929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ae63-041a-44b6-a2ae-7c0af7c6c6bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.500091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f564ceebad7f47558926965e396bf10d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.500864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ae63-041a-44b6-a2ae-7c0af7c6c6bf admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.503846 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.568337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 906/1819] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:09 2022] POST /identity/v3/projects => generated 393 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:09.569353 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ae63-041a-44b6-a2ae-7c0af7c6c6bf admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.602089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:09.702089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f564ceebad7f47558926965e396bf10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.719154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ae63-041a-44b6-a2ae-7c0af7c6c6bf admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.728760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801f48a-a550-4ddf-9ad1-cc38cc460b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.729850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801f48a-a550-4ddf-9ad1-cc38cc460b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.730773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801f48a-a550-4ddf-9ad1-cc38cc460b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.731307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801f48a-a550-4ddf-9ad1-cc38cc460b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.732491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801f48a-a550-4ddf-9ad1-cc38cc460b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.734803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801f48a-a550-4ddf-9ad1-cc38cc460b0f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.737313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f564ceebad7f47558926965e396bf10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.738965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f564ceebad7f47558926965e396bf10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.757693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 907/1820] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:09.759100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801f48a-a550-4ddf-9ad1-cc38cc460b0f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.761173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b801f48a-a550-4ddf-9ad1-cc38cc460b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:09.771289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f564ceebad7f47558926965e396bf10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.778131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801f48a-a550-4ddf-9ad1-cc38cc460b0f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.785328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3e47c-5e27-47bb-998f-a607192f86a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.786459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f564ceebad7f47558926965e396bf10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:09.787128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3e47c-5e27-47bb-998f-a607192f86a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.787604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3e47c-5e27-47bb-998f-a607192f86a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.787975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3e47c-5e27-47bb-998f-a607192f86a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.789226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3e47c-5e27-47bb-998f-a607192f86a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.791492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3e47c-5e27-47bb-998f-a607192f86a7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.794708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 914/1821] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:09 2022] DELETE /identity/v3/users/f564ceebad7f47558926965e396bf10d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:09.796131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.798045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:09.826468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 908/1822] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:09 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:09.828793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea297c-50ae-4bc4-a3d8-11090a85375b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.828793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea297c-50ae-4bc4-a3d8-11090a85375b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.828945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea297c-50ae-4bc4-a3d8-11090a85375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.858006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2fea297c-50ae-4bc4-a3d8-11090a85375b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:09.860904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2fea297c-50ae-4bc4-a3d8-11090a85375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:09.915217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:09.948405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bccec8-5e88-4f14-ab27-ff3688c71bc1 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.953851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aee6d8-cb56-488a-ba97-c5621f4dc495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.954486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aee6d8-cb56-488a-ba97-c5621f4dc495 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.954784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aee6d8-cb56-488a-ba97-c5621f4dc495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.955059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aee6d8-cb56-488a-ba97-c5621f4dc495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.955718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aee6d8-cb56-488a-ba97-c5621f4dc495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.957496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 909/1823] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:09.958311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aee6d8-cb56-488a-ba97-c5621f4dc495 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.958684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea297c-50ae-4bc4-a3d8-11090a85375b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.970181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea297c-50ae-4bc4-a3d8-11090a85375b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.974366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 915/1824] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:09.976473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57208984-4a69-410f-86f2-957a5356a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:09.978610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57208984-4a69-410f-86f2-957a5356a4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:09.979074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57208984-4a69-410f-86f2-957a5356a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:09.979431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57208984-4a69-410f-86f2-957a5356a4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:09.979924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aee6d8-cb56-488a-ba97-c5621f4dc495 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:09.980672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57208984-4a69-410f-86f2-957a5356a4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:09.982903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57208984-4a69-410f-86f2-957a5356a4ac admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:09.992675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aee6d8-cb56-488a-ba97-c5621f4dc495 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:09.999291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c5eea-331b-4288-9f6d-cd25dc179e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:10.000126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c5eea-331b-4288-9f6d-cd25dc179e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:10.000414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c5eea-331b-4288-9f6d-cd25dc179e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:10.001022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c5eea-331b-4288-9f6d-cd25dc179e5f admin admin] PATH_INFO: `/v3/projects/b90dc8d77a4448b084b7e8df35e8ca39/users/82b7945788e7492da0f23a043d9fded8/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:10.002262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 910/1825] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:10.003338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57208984-4a69-410f-86f2-957a5356a4ac admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:10.016040 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57208984-4a69-410f-86f2-957a5356a4ac admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:10.023200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c5eea-331b-4288-9f6d-cd25dc179e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90dc8d77a4448b084b7e8df35e8ca39, user_id=82b7945788e7492da0f23a043d9fded8, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:10.024887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a506238-90f8-472d-8bcc-59182caaa44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:10.025618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a506238-90f8-472d-8bcc-59182caaa44a admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:10.025965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a506238-90f8-472d-8bcc-59182caaa44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:10.026174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c5eea-331b-4288-9f6d-cd25dc179e5f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:10.026285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a506238-90f8-472d-8bcc-59182caaa44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:10.027040 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a506238-90f8-472d-8bcc-59182caaa44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:10.028752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a506238-90f8-472d-8bcc-59182caaa44a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:10.043189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 911/1826] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:10.047577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a506238-90f8-472d-8bcc-59182caaa44a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:10.054506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 916/1827] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:09 2022] PUT /identity/v3/projects/b90dc8d77a4448b084b7e8df35e8ca39/users/82b7945788e7492da0f23a043d9fded8/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:10.066499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc0739-0267-491f-b2ee-20cd69e5b9dd None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:10.066901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc0739-0267-491f-b2ee-20cd69e5b9dd None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:10.067067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc0739-0267-491f-b2ee-20cd69e5b9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:10.072300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a506238-90f8-472d-8bcc-59182caaa44a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:10.115942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-69cc0739-0267-491f-b2ee-20cd69e5b9dd None None] MFA Rules not processed for user `82b7945788e7492da0f23a043d9fded8`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:10.117318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-69cc0739-0267-491f-b2ee-20cd69e5b9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:10.221067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dd704-4091-41bb-a752-b818345bb5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:10.222558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dd704-4091-41bb-a752-b818345bb5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:10.222851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dd704-4091-41bb-a752-b818345bb5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:10.223597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dd704-4091-41bb-a752-b818345bb5d7 admin admin] PATH_INFO: `/v3/projects/8e006c64a9e9460eb29b82a490357f5c/users/730f47ff5ed04ec99b608a19e041f0e1/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:10.249270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dd704-4091-41bb-a752-b818345bb5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e006c64a9e9460eb29b82a490357f5c, user_id=730f47ff5ed04ec99b608a19e041f0e1, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:10.252519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dd704-4091-41bb-a752-b818345bb5d7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:10.256181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:10.259705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 917/1828] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:10.260674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc0739-0267-491f-b2ee-20cd69e5b9dd None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:10.262780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-69cc0739-0267-491f-b2ee-20cd69e5b9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:10.275141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 912/1829] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:10 2022] PUT /identity/v3/projects/8e006c64a9e9460eb29b82a490357f5c/users/730f47ff5ed04ec99b608a19e041f0e1/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:10.288207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dd704-4091-41bb-a752-b818345bb5d7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:10.294563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d34dd704-4091-41bb-a752-b818345bb5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:10.411798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc0739-0267-491f-b2ee-20cd69e5b9dd None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:10.426828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dd704-4091-41bb-a752-b818345bb5d7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:10.431135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb69a37-9335-4884-b87b-e934a8f48579 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab45d09f8724d9ca5b6fb1fa050fdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:10.431767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb69a37-9335-4884-b87b-e934a8f48579 service glance] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:10.432618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb69a37-9335-4884-b87b-e934a8f48579 service glance] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:10.432902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb69a37-9335-4884-b87b-e934a8f48579 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:10.488051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be029-ce6b-4c4b-ae7b-8e138f3270ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:10.488909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be029-ce6b-4c4b-ae7b-8e138f3270ba service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:10.489368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be029-ce6b-4c4b-ae7b-8e138f3270ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:10.489784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be029-ce6b-4c4b-ae7b-8e138f3270ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:10.505928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:10.527783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb69a37-9335-4884-b87b-e934a8f48579 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:10.527783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb69a37-9335-4884-b87b-e934a8f48579 service glance] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:10.537533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 913/1830] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:10.539097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997c9f-868a-4110-9614-490c40148b84 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:10.539390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997c9f-868a-4110-9614-490c40148b84 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:10.539670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997c9f-868a-4110-9614-490c40148b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:10.597652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-38997c9f-868a-4110-9614-490c40148b84 None None] MFA Rules not processed for user `730f47ff5ed04ec99b608a19e041f0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:10.598899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-38997c9f-868a-4110-9614-490c40148b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:10.599011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be029-ce6b-4c4b-ae7b-8e138f3270ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:10.600408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be029-ce6b-4c4b-ae7b-8e138f3270ba service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:10.612405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 918/1831] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:10.748464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 914/1832] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:10.753957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be029-ce6b-4c4b-ae7b-8e138f3270ba service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:10.769116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be029-ce6b-4c4b-ae7b-8e138f3270ba service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:10.776956 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322fde0-fb50-483b-996c-d1fe13b5d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:10.778061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322fde0-fb50-483b-996c-d1fe13b5d2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:10.778610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322fde0-fb50-483b-996c-d1fe13b5d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:10.779293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322fde0-fb50-483b-996c-d1fe13b5d2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:10.780132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322fde0-fb50-483b-996c-d1fe13b5d2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:10.782678 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322fde0-fb50-483b-996c-d1fe13b5d2b1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:10.824713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 919/1833] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:10 2022] POST /identity/v3/projects => generated 391 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:10.830353 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997c9f-868a-4110-9614-490c40148b84 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:10.855185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997c9f-868a-4110-9614-490c40148b84 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:10.882761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:10.968369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451a0bc-6ff3-4125-8437-10e585b43b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:10.969011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451a0bc-6ff3-4125-8437-10e585b43b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:10.969464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451a0bc-6ff3-4125-8437-10e585b43b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:10.969797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451a0bc-6ff3-4125-8437-10e585b43b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:10.970466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451a0bc-6ff3-4125-8437-10e585b43b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:10.973955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451a0bc-6ff3-4125-8437-10e585b43b33 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:11.012867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 915/1834] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:10 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:11.016756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322fde0-fb50-483b-996c-d1fe13b5d2b1 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:11.029773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322fde0-fb50-483b-996c-d1fe13b5d2b1 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:11.040513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e1090-e351-48f9-9119-06e349c16539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:11.041489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e1090-e351-48f9-9119-06e349c16539 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:11.041689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e1090-e351-48f9-9119-06e349c16539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:11.042013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e1090-e351-48f9-9119-06e349c16539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:11.043027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e1090-e351-48f9-9119-06e349c16539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:11.045086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e1090-e351-48f9-9119-06e349c16539 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:11.071618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 920/1835] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:11.076143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451a0bc-6ff3-4125-8437-10e585b43b33 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:11.095215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451a0bc-6ff3-4125-8437-10e585b43b33 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:11.104865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100bdd1-997d-4a79-b5b8-00c4e8d183b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:11.105932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100bdd1-997d-4a79-b5b8-00c4e8d183b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:11.106592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100bdd1-997d-4a79-b5b8-00c4e8d183b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:11.107202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100bdd1-997d-4a79-b5b8-00c4e8d183b4 admin admin] PATH_INFO: `/v3/projects/ab7b2808dbe34a63b02bf87ec5a05b2c/users/f2ad357025754d19b867c0c95837dfbd/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:11.128910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100bdd1-997d-4a79-b5b8-00c4e8d183b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7b2808dbe34a63b02bf87ec5a05b2c, user_id=f2ad357025754d19b867c0c95837dfbd, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:11.132283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100bdd1-997d-4a79-b5b8-00c4e8d183b4 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:11.158399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 916/1836] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:11 2022] PUT /identity/v3/projects/ab7b2808dbe34a63b02bf87ec5a05b2c/users/f2ad357025754d19b867c0c95837dfbd/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:11.165617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e1090-e351-48f9-9119-06e349c16539 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:11.179886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e1090-e351-48f9-9119-06e349c16539 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:11.304334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042aaf1-1433-426d-a693-b19d2a8f1472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:11.305866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042aaf1-1433-426d-a693-b19d2a8f1472 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:11.307658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042aaf1-1433-426d-a693-b19d2a8f1472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:11.308065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042aaf1-1433-426d-a693-b19d2a8f1472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:11.310105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042aaf1-1433-426d-a693-b19d2a8f1472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:11.317359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042aaf1-1433-426d-a693-b19d2a8f1472 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:11.353713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 921/1837] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:11.355725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100bdd1-997d-4a79-b5b8-00c4e8d183b4 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:11.375352 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100bdd1-997d-4a79-b5b8-00c4e8d183b4 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:11.385800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0707126-7089-4626-857b-21e25cfb0799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:11.387193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0707126-7089-4626-857b-21e25cfb0799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:11.388680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0707126-7089-4626-857b-21e25cfb0799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:11.389227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0707126-7089-4626-857b-21e25cfb0799 admin admin] PATH_INFO: `/v3/projects/ab7b2808dbe34a63b02bf87ec5a05b2c/users/f2ad357025754d19b867c0c95837dfbd/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:11.396094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0707126-7089-4626-857b-21e25cfb0799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7b2808dbe34a63b02bf87ec5a05b2c, user_id=f2ad357025754d19b867c0c95837dfbd, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:11.400818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0707126-7089-4626-857b-21e25cfb0799 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:11.416585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 917/1838] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:11 2022] PUT /identity/v3/projects/ab7b2808dbe34a63b02bf87ec5a05b2c/users/f2ad357025754d19b867c0c95837dfbd/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:11.430517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3785ae3-ce0a-4e87-b01e-811e6b7829e4 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:11.430762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3785ae3-ce0a-4e87-b01e-811e6b7829e4 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:11.431046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3785ae3-ce0a-4e87-b01e-811e6b7829e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:11.494772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f3785ae3-ce0a-4e87-b01e-811e6b7829e4 None None] MFA Rules not processed for user `f2ad357025754d19b867c0c95837dfbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:11.496012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f3785ae3-ce0a-4e87-b01e-811e6b7829e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:11.533783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0707126-7089-4626-857b-21e25cfb0799 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:11.536832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a0707126-7089-4626-857b-21e25cfb0799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:11.622431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:11.638205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 922/1839] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:11.654780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3785ae3-ce0a-4e87-b01e-811e6b7829e4 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:11.656188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f3785ae3-ce0a-4e87-b01e-811e6b7829e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:11.679608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0707126-7089-4626-857b-21e25cfb0799 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:11.687719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:11.688439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:11.688668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:11.689621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] PATH_INFO: `/v3/users/042a00546473489fa1e747f186930f54` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:11.694393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=042a00546473489fa1e747f186930f54)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:11.697653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:11.769576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3785ae3-ce0a-4e87-b01e-811e6b7829e4 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:11.779004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042a00546473489fa1e747f186930f54'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:11.779842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c3fc4-d290-4e16-8ba8-99b3e903ab22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:11.780617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c3fc4-d290-4e16-8ba8-99b3e903ab22 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:11.781005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c3fc4-d290-4e16-8ba8-99b3e903ab22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:11.781409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c3fc4-d290-4e16-8ba8-99b3e903ab22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:11.790170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042a00546473489fa1e747f186930f54'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:11.794449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042a00546473489fa1e747f186930f54'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:11.798508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c3fc4-d290-4e16-8ba8-99b3e903ab22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:11.803368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c3fc4-d290-4e16-8ba8-99b3e903ab22 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:11.822371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042a00546473489fa1e747f186930f54'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:11.824499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:11.827876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 923/1840] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:11.836099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042a00546473489fa1e747f186930f54'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:11.872656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 918/1841] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:11 2022] DELETE /identity/v3/users/042a00546473489fa1e747f186930f54 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:11.877070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca084cd-51ce-4505-aed3-681dc7b556e8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:11.877414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca084cd-51ce-4505-aed3-681dc7b556e8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:11.877699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca084cd-51ce-4505-aed3-681dc7b556e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:11.945958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-9ca084cd-51ce-4505-aed3-681dc7b556e8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:11.947880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9ca084cd-51ce-4505-aed3-681dc7b556e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:11.948223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:11.950534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:12.120875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8edda3-7cb3-4c50-b269-f758ea3eb89d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:12.125526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:12.125874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:12.126236 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:12.126425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:12.128325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:12.143910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 924/1842] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:12.163475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca084cd-51ce-4505-aed3-681dc7b556e8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:12.165299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9ca084cd-51ce-4505-aed3-681dc7b556e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:12.232896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:12.234826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:12.253366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 919/1843] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:12.291204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca084cd-51ce-4505-aed3-681dc7b556e8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:12.301940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aa54f-28f4-4731-9626-f365290ddfda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:12.302597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa54f-28f4-4731-9626-f365290ddfda service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:12.303263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa54f-28f4-4731-9626-f365290ddfda service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:12.303620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa54f-28f4-4731-9626-f365290ddfda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:12.319404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aa54f-28f4-4731-9626-f365290ddfda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:12.324106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aa54f-28f4-4731-9626-f365290ddfda service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:12.382628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 925/1844] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:12.582001 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:12.583424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:12.615893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960191b-c234-4d5c-aa0f-a4f5f62ba97b service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:12.630673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:12.631656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:12.632509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:12.632800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] PATH_INFO: `/v3/projects/05eb5cd0674944bbae0d637e2e56233b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:12.634984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05eb5cd0674944bbae0d637e2e56233b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:12.638195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:12.767841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05eb5cd0674944bbae0d637e2e56233b', 'request_id': 'req-06695773-7759-4a6a-ba37-0ef73a1df65f'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:12.798217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05eb5cd0674944bbae0d637e2e56233b', 'request_id': 'req-06695773-7759-4a6a-ba37-0ef73a1df65f'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:12.819637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05eb5cd0674944bbae0d637e2e56233b', 'request_id': 'req-06695773-7759-4a6a-ba37-0ef73a1df65f'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:12.856285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] The token cache is being invalidate because project 05eb5cd0674944bbae0d637e2e56233b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:12.856820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:12.860349 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:12.864679 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 920/1845] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:12 2022] DELETE /identity/v3/projects/05eb5cd0674944bbae0d637e2e56233b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:12.869882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aa54f-28f4-4731-9626-f365290ddfda service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:12.882076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aa54f-28f4-4731-9626-f365290ddfda service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:12.965193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:12.994839 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:12.996076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:12.996779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:12.997128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] PATH_INFO: `/v3/users/77a66ab9478f4618b0c13831151a8f56` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:13.005838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a66ab9478f4618b0c13831151a8f56)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:13.008312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:13.097417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a66ab9478f4618b0c13831151a8f56'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.124557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a66ab9478f4618b0c13831151a8f56'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.127332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a66ab9478f4618b0c13831151a8f56'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.159828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a66ab9478f4618b0c13831151a8f56'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.168961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a66ab9478f4618b0c13831151a8f56'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.180629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 926/1846] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:12 2022] DELETE /identity/v3/users/77a66ab9478f4618b0c13831151a8f56 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:13.228832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:13.230674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:13.250250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695773-7759-4a6a-ba37-0ef73a1df65f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:13.286655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:13.323715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:13.324369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:13.324648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:13.324920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] PATH_INFO: `/v3/projects/699c48287b9443489f3fb6a673bb6a0e` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:13.326098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699c48287b9443489f3fb6a673bb6a0e)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:13.328275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:13.393177 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699c48287b9443489f3fb6a673bb6a0e', 'request_id': 'req-a0e42f41-6596-4e67-a127-2b37ad09ded5'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.408077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699c48287b9443489f3fb6a673bb6a0e', 'request_id': 'req-a0e42f41-6596-4e67-a127-2b37ad09ded5'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.414957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699c48287b9443489f3fb6a673bb6a0e', 'request_id': 'req-a0e42f41-6596-4e67-a127-2b37ad09ded5'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.428874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] The token cache is being invalidate because project 699c48287b9443489f3fb6a673bb6a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:13.429182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.429956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.431995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 921/1847] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:13 2022] DELETE /identity/v3/projects/699c48287b9443489f3fb6a673bb6a0e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:13.435811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:13.437286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:13.472423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98470280-2719-4851-8a08-413e8f8c4173 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:13.569359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:13.573632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:13.574381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:13.574841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] PATH_INFO: `/v3/users/6c41f48de3684c3f83b8bc9cf239264d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:13.576626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c41f48de3684c3f83b8bc9cf239264d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:13.578921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:13.605142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:13.606424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:13.625651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42f41-6596-4e67-a127-2b37ad09ded5 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:13.631040 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:13.631685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:13.632495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:13.632495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] PATH_INFO: `/v3/projects/e985f43035a94ea9ada5f34a05a64b0a` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:13.634044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e985f43035a94ea9ada5f34a05a64b0a)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:13.636231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:13.657420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c41f48de3684c3f83b8bc9cf239264d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.667459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c41f48de3684c3f83b8bc9cf239264d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.668206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c41f48de3684c3f83b8bc9cf239264d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.678842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:13.698522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c41f48de3684c3f83b8bc9cf239264d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.711039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e010e8bc-7ca8-498f-a60a-3b4fd4a83f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c41f48de3684c3f83b8bc9cf239264d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.715684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e985f43035a94ea9ada5f34a05a64b0a', 'request_id': 'req-1d6e6a95-49eb-4da5-b652-988a6f865449'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.721814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 927/1848] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:13 2022] DELETE /identity/v3/users/6c41f48de3684c3f83b8bc9cf239264d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:13.724935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e985f43035a94ea9ada5f34a05a64b0a', 'request_id': 'req-1d6e6a95-49eb-4da5-b652-988a6f865449'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.732007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e985f43035a94ea9ada5f34a05a64b0a', 'request_id': 'req-1d6e6a95-49eb-4da5-b652-988a6f865449'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.745058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] The token cache is being invalidate because project e985f43035a94ea9ada5f34a05a64b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:13.745380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.746027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1d6e6a95-49eb-4da5-b652-988a6f865449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:13.750751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 922/1849] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:13 2022] DELETE /identity/v3/projects/e985f43035a94ea9ada5f34a05a64b0a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:13.755744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750f56-f35a-4ed4-b22b-1d920b5ce2f9 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:13.756107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750f56-f35a-4ed4-b22b-1d920b5ce2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:13.756742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750f56-f35a-4ed4-b22b-1d920b5ce2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:13.779951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-13750f56-f35a-4ed4-b22b-1d920b5ce2f9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:13.781384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-13750f56-f35a-4ed4-b22b-1d920b5ce2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:13.864028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 928/1850] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:13.872701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c433682-83c7-4a2f-ba90-f9026fb39c57 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:13.872701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c433682-83c7-4a2f-ba90-f9026fb39c57 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:13.872701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c433682-83c7-4a2f-ba90-f9026fb39c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:13.948132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-9c433682-83c7-4a2f-ba90-f9026fb39c57 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:13.949499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9c433682-83c7-4a2f-ba90-f9026fb39c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:13.983895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 923/1851] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:13.987820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750f56-f35a-4ed4-b22b-1d920b5ce2f9 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:14.000246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750f56-f35a-4ed4-b22b-1d920b5ce2f9 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:14.014816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c59788-53b0-4bf3-9a73-f3a4a1d61c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:14.016384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c59788-53b0-4bf3-9a73-f3a4a1d61c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.017429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c59788-53b0-4bf3-9a73-f3a4a1d61c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.017990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c59788-53b0-4bf3-9a73-f3a4a1d61c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.019745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c59788-53b0-4bf3-9a73-f3a4a1d61c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:14.020355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c59788-53b0-4bf3-9a73-f3a4a1d61c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:14.022811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c59788-53b0-4bf3-9a73-f3a4a1d61c1a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:14.043143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 929/1852] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:14.046753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c433682-83c7-4a2f-ba90-f9026fb39c57 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:14.063567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c433682-83c7-4a2f-ba90-f9026fb39c57 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:14.078482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540dc60-41d4-4ef9-a13f-746576a75a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:14.079426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540dc60-41d4-4ef9-a13f-746576a75a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.080461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540dc60-41d4-4ef9-a13f-746576a75a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.080951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540dc60-41d4-4ef9-a13f-746576a75a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.082523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540dc60-41d4-4ef9-a13f-746576a75a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:14.085425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540dc60-41d4-4ef9-a13f-746576a75a2c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:14.129728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 924/1853] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:14 2022] POST /identity/v3/projects => generated 389 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:14.135831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c59788-53b0-4bf3-9a73-f3a4a1d61c1a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:14.162664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c59788-53b0-4bf3-9a73-f3a4a1d61c1a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:14.336506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540dc60-41d4-4ef9-a13f-746576a75a2c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:14.339053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e540dc60-41d4-4ef9-a13f-746576a75a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:14.360714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6862850-975e-4ace-9d00-e42115d1d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:14.361471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6862850-975e-4ace-9d00-e42115d1d116 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.361770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6862850-975e-4ace-9d00-e42115d1d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.363088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6862850-975e-4ace-9d00-e42115d1d116 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.365082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6862850-975e-4ace-9d00-e42115d1d116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:14.370624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6862850-975e-4ace-9d00-e42115d1d116 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:14.374792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:14.447123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 930/1854] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:14 2022] POST /identity/v3/users => generated 295 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:14.448299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6862850-975e-4ace-9d00-e42115d1d116 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:14.498154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6862850-975e-4ace-9d00-e42115d1d116 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:14.508512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228f10a-5e57-44c5-90cc-f3752664c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:14.509586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228f10a-5e57-44c5-90cc-f3752664c3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.509999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228f10a-5e57-44c5-90cc-f3752664c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.510428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228f10a-5e57-44c5-90cc-f3752664c3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.511604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228f10a-5e57-44c5-90cc-f3752664c3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:14.517868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228f10a-5e57-44c5-90cc-f3752664c3cf admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:14.530932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540dc60-41d4-4ef9-a13f-746576a75a2c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:14.535630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 931/1855] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:14.536724 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:14.537589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.537877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.538441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] PATH_INFO: `/v3/projects/b9f5229ace5e465ba44bb7789a2d2ec2` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.539583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f5229ace5e465ba44bb7789a2d2ec2)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:14.539810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228f10a-5e57-44c5-90cc-f3752664c3cf admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:14.541956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:14.556090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228f10a-5e57-44c5-90cc-f3752664c3cf admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:14.579391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4e0b0-7a0a-4d67-8afe-c6820f9485e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:14.580038 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4e0b0-7a0a-4d67-8afe-c6820f9485e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.581097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4e0b0-7a0a-4d67-8afe-c6820f9485e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.581418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4e0b0-7a0a-4d67-8afe-c6820f9485e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.582223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4e0b0-7a0a-4d67-8afe-c6820f9485e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:14.584990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4e0b0-7a0a-4d67-8afe-c6820f9485e1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:14.601869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 932/1856] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:14.610472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4e0b0-7a0a-4d67-8afe-c6820f9485e1 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:14.623023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f5229ace5e465ba44bb7789a2d2ec2', 'request_id': 'req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:14.625304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4e0b0-7a0a-4d67-8afe-c6820f9485e1 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:14.633600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f5229ace5e465ba44bb7789a2d2ec2', 'request_id': 'req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:14.645686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f5229ace5e465ba44bb7789a2d2ec2', 'request_id': 'req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:14.676520 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] The token cache is being invalidate because project b9f5229ace5e465ba44bb7789a2d2ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:14.676743 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:14.678735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6e0e4edd-a02a-4c77-8004-8bb25a7c72b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:14.681549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 925/1857] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:14 2022] DELETE /identity/v3/projects/b9f5229ace5e465ba44bb7789a2d2ec2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:14.687433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe92f9-d655-4af8-b606-2ccfd09d3368 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.688207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe92f9-d655-4af8-b606-2ccfd09d3368 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.688207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe92f9-d655-4af8-b606-2ccfd09d3368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.688765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:14.740237 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ebfe92f9-d655-4af8-b606-2ccfd09d3368 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:14.742781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ebfe92f9-d655-4af8-b606-2ccfd09d3368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:14.767944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fd817-ce24-42ac-96b6-ebc89bf5b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:14.769093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd817-ce24-42ac-96b6-ebc89bf5b6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.769619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd817-ce24-42ac-96b6-ebc89bf5b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.770104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fd817-ce24-42ac-96b6-ebc89bf5b6d7 admin admin] PATH_INFO: `/v3/projects/400c1ce0825f4cf0b9b1595a3485b35b/users/82a6a2c796f64ca7b826a432b38ccec4/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.808003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fd817-ce24-42ac-96b6-ebc89bf5b6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400c1ce0825f4cf0b9b1595a3485b35b, user_id=82a6a2c796f64ca7b826a432b38ccec4, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:14.811050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fd817-ce24-42ac-96b6-ebc89bf5b6d7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:14.850375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 933/1858] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:14 2022] PUT /identity/v3/projects/400c1ce0825f4cf0b9b1595a3485b35b/users/82a6a2c796f64ca7b826a432b38ccec4/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:14.863607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f414c11-ebd4-4dab-ad68-f2d55bd28dba None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.864173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f414c11-ebd4-4dab-ad68-f2d55bd28dba None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.864708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f414c11-ebd4-4dab-ad68-f2d55bd28dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.874627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 926/1859] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:14.876319 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6775253-8494-43da-99ab-72cb293107ee None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:14.876710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6775253-8494-43da-99ab-72cb293107ee None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:14.877076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6775253-8494-43da-99ab-72cb293107ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:14.904860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-b6775253-8494-43da-99ab-72cb293107ee None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:14.913917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b6775253-8494-43da-99ab-72cb293107ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:14.928908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-8f414c11-ebd4-4dab-ad68-f2d55bd28dba None None] MFA Rules not processed for user `82a6a2c796f64ca7b826a432b38ccec4`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:14.930154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8f414c11-ebd4-4dab-ad68-f2d55bd28dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:15.007241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:15.054582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 927/1860] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:15.056446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6775253-8494-43da-99ab-72cb293107ee None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.097744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6775253-8494-43da-99ab-72cb293107ee None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.107045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 934/1861] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:15.111232 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f414c11-ebd4-4dab-ad68-f2d55bd28dba None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.114853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8f414c11-ebd4-4dab-ad68-f2d55bd28dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:15.116791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357dc0c-601e-4222-b2eb-ec8af7da6323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.117540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357dc0c-601e-4222-b2eb-ec8af7da6323 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.117896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357dc0c-601e-4222-b2eb-ec8af7da6323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.119110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357dc0c-601e-4222-b2eb-ec8af7da6323 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.119809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357dc0c-601e-4222-b2eb-ec8af7da6323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:15.120125 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357dc0c-601e-4222-b2eb-ec8af7da6323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.123707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357dc0c-601e-4222-b2eb-ec8af7da6323 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:15.134875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f414c11-ebd4-4dab-ad68-f2d55bd28dba None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.140654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db8814-9f9b-4c29-9628-648a701be794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.141339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8814-9f9b-4c29-9628-648a701be794 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.141702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8814-9f9b-4c29-9628-648a701be794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.142055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8814-9f9b-4c29-9628-648a701be794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.143062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db8814-9f9b-4c29-9628-648a701be794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.146660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db8814-9f9b-4c29-9628-648a701be794 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:15.173298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 928/1862] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:15.180558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357dc0c-601e-4222-b2eb-ec8af7da6323 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.203156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357dc0c-601e-4222-b2eb-ec8af7da6323 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.206562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 935/1863] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:15 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:15.211340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db8814-9f9b-4c29-9628-648a701be794 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.398266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6394b-bdb2-4a2f-b37b-edd38fff6d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.399981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6394b-bdb2-4a2f-b37b-edd38fff6d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.400367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6394b-bdb2-4a2f-b37b-edd38fff6d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.400652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6394b-bdb2-4a2f-b37b-edd38fff6d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.401443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6394b-bdb2-4a2f-b37b-edd38fff6d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.404044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6394b-bdb2-4a2f-b37b-edd38fff6d03 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:15.417703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db8814-9f9b-4c29-9628-648a701be794 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.435230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7ac85-2438-4a11-a9e3-759142a6605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.437383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7ac85-2438-4a11-a9e3-759142a6605a admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.437846 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7ac85-2438-4a11-a9e3-759142a6605a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.438503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7ac85-2438-4a11-a9e3-759142a6605a admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.441718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7ac85-2438-4a11-a9e3-759142a6605a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.446396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7ac85-2438-4a11-a9e3-759142a6605a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:15.519718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 936/1864] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:15 2022] POST /identity/v3/users => generated 300 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:15.523659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7ac85-2438-4a11-a9e3-759142a6605a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.540098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 929/1865] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:15 2022] POST /identity/v3/projects => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:15.541609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6394b-bdb2-4a2f-b37b-edd38fff6d03 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.564371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7ac85-2438-4a11-a9e3-759142a6605a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.598252 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:15.660743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9998b-a016-4634-a559-280396572527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.660743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9998b-a016-4634-a559-280396572527 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.660743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9998b-a016-4634-a559-280396572527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.660743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9998b-a016-4634-a559-280396572527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.661610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9998b-a016-4634-a559-280396572527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.663241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9998b-a016-4634-a559-280396572527 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:15.677193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 937/1866] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:15.682372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9998b-a016-4634-a559-280396572527 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.714172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9998b-a016-4634-a559-280396572527 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.726144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d9df-3966-4317-84c9-480ee4f1be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.726962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d9df-3966-4317-84c9-480ee4f1be71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.727306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d9df-3966-4317-84c9-480ee4f1be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.727651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d9df-3966-4317-84c9-480ee4f1be71 admin admin] PATH_INFO: `/v3/projects/e1556b7d449f48db89d3128d92813d06/users/e96ac0820ae24e7f92b2aeec42d1dca6/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.735105 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6394b-bdb2-4a2f-b37b-edd38fff6d03 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.746955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19971101-c148-4a98-b672-06548412a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.747455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19971101-c148-4a98-b672-06548412a9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.747741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19971101-c148-4a98-b672-06548412a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.748015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19971101-c148-4a98-b672-06548412a9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.750597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19971101-c148-4a98-b672-06548412a9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.751574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d9df-3966-4317-84c9-480ee4f1be71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1556b7d449f48db89d3128d92813d06, user_id=e96ac0820ae24e7f92b2aeec42d1dca6, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.752614 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19971101-c148-4a98-b672-06548412a9d4 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:15.755824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d9df-3966-4317-84c9-480ee4f1be71 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:15.779020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 938/1867] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:15 2022] PUT /identity/v3/projects/e1556b7d449f48db89d3128d92813d06/users/e96ac0820ae24e7f92b2aeec42d1dca6/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:15.780556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d9df-3966-4317-84c9-480ee4f1be71 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.798063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 930/1868] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:15 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:15.802382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19971101-c148-4a98-b672-06548412a9d4 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.823617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19971101-c148-4a98-b672-06548412a9d4 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.907715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d9df-3966-4317-84c9-480ee4f1be71 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.914525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04f0fb-da1d-41f9-be70-85188872f5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.915260 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04f0fb-da1d-41f9-be70-85188872f5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.915641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04f0fb-da1d-41f9-be70-85188872f5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.916015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04f0fb-da1d-41f9-be70-85188872f5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.917499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04f0fb-da1d-41f9-be70-85188872f5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.920842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04f0fb-da1d-41f9-be70-85188872f5c9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:15.922629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:15.936925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 939/1869] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:15.950200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04f0fb-da1d-41f9-be70-85188872f5c9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:15.976833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3954-7897-4736-a6b1-cd3ca26e57d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.978231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3954-7897-4736-a6b1-cd3ca26e57d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.978231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3954-7897-4736-a6b1-cd3ca26e57d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.978564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d3954-7897-4736-a6b1-cd3ca26e57d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.979285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d3954-7897-4736-a6b1-cd3ca26e57d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.980471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04f0fb-da1d-41f9-be70-85188872f5c9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:15.982088 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d3954-7897-4736-a6b1-cd3ca26e57d9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:15.993349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff78370-da2e-4672-b226-d83ff503e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:15.994817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff78370-da2e-4672-b226-d83ff503e869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:15.995212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff78370-da2e-4672-b226-d83ff503e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:15.995503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff78370-da2e-4672-b226-d83ff503e869 admin admin] PATH_INFO: `/v3/projects/e1556b7d449f48db89d3128d92813d06/users/e96ac0820ae24e7f92b2aeec42d1dca6/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:15.997724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff78370-da2e-4672-b226-d83ff503e869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1556b7d449f48db89d3128d92813d06, user_id=e96ac0820ae24e7f92b2aeec42d1dca6, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:15.998554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 931/1870] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:16.002144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff78370-da2e-4672-b226-d83ff503e869 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:16.002873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3954-7897-4736-a6b1-cd3ca26e57d9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.014783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d3954-7897-4736-a6b1-cd3ca26e57d9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:16.021211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aa4bd-cace-4bb8-8283-ad3223a83b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:16.021878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aa4bd-cace-4bb8-8283-ad3223a83b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.022162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aa4bd-cace-4bb8-8283-ad3223a83b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.022435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aa4bd-cace-4bb8-8283-ad3223a83b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.023376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9aa4bd-cace-4bb8-8283-ad3223a83b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:16.025429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9aa4bd-cace-4bb8-8283-ad3223a83b4a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:16.031607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 940/1871] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:15 2022] PUT /identity/v3/projects/e1556b7d449f48db89d3128d92813d06/users/e96ac0820ae24e7f92b2aeec42d1dca6/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:16.048823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b557075-f456-4ca6-adbf-68c31211176e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.048823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b557075-f456-4ca6-adbf-68c31211176e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.048823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b557075-f456-4ca6-adbf-68c31211176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.050906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 932/1872] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:16.054790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aa4bd-cace-4bb8-8283-ad3223a83b4a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.074293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aa4bd-cace-4bb8-8283-ad3223a83b4a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:16.090503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-2b557075-f456-4ca6-adbf-68c31211176e None None] MFA Rules not processed for user `e96ac0820ae24e7f92b2aeec42d1dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:16.091909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2b557075-f456-4ca6-adbf-68c31211176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:16.180331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0ad2f-a0d2-4ac5-b59c-f95db91f3af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:16.180932 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:16.181526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0ad2f-a0d2-4ac5-b59c-f95db91f3af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.181881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0ad2f-a0d2-4ac5-b59c-f95db91f3af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.182170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0ad2f-a0d2-4ac5-b59c-f95db91f3af5 admin admin] PATH_INFO: `/v3/projects/d72af813f83041d3be45a253e38878f3/users/de48f63362644ff9babc349352587225/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.189693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 941/1873] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:16.209668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0ad2f-a0d2-4ac5-b59c-f95db91f3af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72af813f83041d3be45a253e38878f3, user_id=de48f63362644ff9babc349352587225, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:16.209886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b557075-f456-4ca6-adbf-68c31211176e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.209977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0ad2f-a0d2-4ac5-b59c-f95db91f3af5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:16.210086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2b557075-f456-4ca6-adbf-68c31211176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:16.240373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 933/1874] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:16 2022] PUT /identity/v3/projects/d72af813f83041d3be45a253e38878f3/users/de48f63362644ff9babc349352587225/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:16.250583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3a67c-17af-455e-807e-6a45d775db90 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.252063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3a67c-17af-455e-807e-6a45d775db90 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.252537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3a67c-17af-455e-807e-6a45d775db90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.288118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e4c3a67c-17af-455e-807e-6a45d775db90 None None] MFA Rules not processed for user `de48f63362644ff9babc349352587225`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:16.289563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e4c3a67c-17af-455e-807e-6a45d775db90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:16.310171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b557075-f456-4ca6-adbf-68c31211176e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:16.369767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 934/1875] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:16.375035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3a67c-17af-455e-807e-6a45d775db90 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.383464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66327073-886b-40a6-86ef-a9bac1fdcffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:16.384077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327073-886b-40a6-86ef-a9bac1fdcffb service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.384359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327073-886b-40a6-86ef-a9bac1fdcffb service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.384632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327073-886b-40a6-86ef-a9bac1fdcffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.444962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:16.472981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66327073-886b-40a6-86ef-a9bac1fdcffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:16.472981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66327073-886b-40a6-86ef-a9bac1fdcffb service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:16.483580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3a67c-17af-455e-807e-6a45d775db90 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:16.485976 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 942/1876] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:16.491712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7c711-b88e-402f-8cbe-de90973ced3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:16.492351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7c711-b88e-402f-8cbe-de90973ced3f admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.492679 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7c711-b88e-402f-8cbe-de90973ced3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.492900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7c711-b88e-402f-8cbe-de90973ced3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.493682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7c711-b88e-402f-8cbe-de90973ced3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:16.495637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7c711-b88e-402f-8cbe-de90973ced3f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:16.541321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 935/1877] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:16 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:16.547108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66327073-886b-40a6-86ef-a9bac1fdcffb service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.565532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66327073-886b-40a6-86ef-a9bac1fdcffb service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:16.661990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7c711-b88e-402f-8cbe-de90973ced3f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.710955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b5678-6c4b-482b-986b-53dd17a63a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:16.712871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5678-6c4b-482b-986b-53dd17a63a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.713426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5678-6c4b-482b-986b-53dd17a63a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.713944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5678-6c4b-482b-986b-53dd17a63a23 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.714974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b5678-6c4b-482b-986b-53dd17a63a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:16.718061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b5678-6c4b-482b-986b-53dd17a63a23 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:16.733765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:16.768115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 943/1878] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:16 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:16.772892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b5678-6c4b-482b-986b-53dd17a63a23 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.792096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b5678-6c4b-482b-986b-53dd17a63a23 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:16.802488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7c711-b88e-402f-8cbe-de90973ced3f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:16.806303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08122-8cfb-48b7-bbdd-20d19029934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:16.806950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08122-8cfb-48b7-bbdd-20d19029934c admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.807305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08122-8cfb-48b7-bbdd-20d19029934c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.807568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08122-8cfb-48b7-bbdd-20d19029934c admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.808235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08122-8cfb-48b7-bbdd-20d19029934c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:16.810099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08122-8cfb-48b7-bbdd-20d19029934c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:16.811805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:16.813715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.814113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.814418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] PATH_INFO: `/v3/users/82a6a2c796f64ca7b826a432b38ccec4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.817708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a6a2c796f64ca7b826a432b38ccec4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:16.821141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:16.825492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 944/1879] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:16.827582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08122-8cfb-48b7-bbdd-20d19029934c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.840546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08122-8cfb-48b7-bbdd-20d19029934c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:16.849219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d28d5-5644-4072-ba0f-db4ee471c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:16.850165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d28d5-5644-4072-ba0f-db4ee471c9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:16.850261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d28d5-5644-4072-ba0f-db4ee471c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:16.850523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d28d5-5644-4072-ba0f-db4ee471c9d6 admin admin] PATH_INFO: `/v3/projects/2cbb77a6f75348aca23363b5f408c490/users/0ce0e0934eb44030b4f70b5552f914d1/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:16.873276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d28d5-5644-4072-ba0f-db4ee471c9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbb77a6f75348aca23363b5f408c490, user_id=0ce0e0934eb44030b4f70b5552f914d1, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:16.876929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d28d5-5644-4072-ba0f-db4ee471c9d6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:16.896035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a6a2c796f64ca7b826a432b38ccec4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:16.897450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 945/1880] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:16 2022] PUT /identity/v3/projects/2cbb77a6f75348aca23363b5f408c490/users/0ce0e0934eb44030b4f70b5552f914d1/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:16.898684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d28d5-5644-4072-ba0f-db4ee471c9d6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.902355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-307d28d5-5644-4072-ba0f-db4ee471c9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:16.907881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a6a2c796f64ca7b826a432b38ccec4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:16.910287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a6a2c796f64ca7b826a432b38ccec4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:16.935853 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a6a2c796f64ca7b826a432b38ccec4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:16.955642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a6a2c796f64ca7b826a432b38ccec4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:16.967772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 936/1881] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:16 2022] DELETE /identity/v3/users/82a6a2c796f64ca7b826a432b38ccec4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:16.968548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:16.970546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:17.001049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d28d5-5644-4072-ba0f-db4ee471c9d6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:17.022218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:17.045797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30043df-b89a-4250-b411-9c32a3c1936c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:17.050924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f3b15-74d2-40ab-a7e7-3ec9fb0d21a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:17.051591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3b15-74d2-40ab-a7e7-3ec9fb0d21a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.051875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3b15-74d2-40ab-a7e7-3ec9fb0d21a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.052149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3b15-74d2-40ab-a7e7-3ec9fb0d21a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.052795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f3b15-74d2-40ab-a7e7-3ec9fb0d21a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:17.054426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f3b15-74d2-40ab-a7e7-3ec9fb0d21a5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:17.065228 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 937/1882] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:17.066713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9fce1-1675-4960-9430-60771df94405 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.067006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9fce1-1675-4960-9430-60771df94405 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.067582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9fce1-1675-4960-9430-60771df94405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.069578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:17.070387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.070683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.070962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] PATH_INFO: `/v3/users/730f47ff5ed04ec99b608a19e041f0e1` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.072255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=730f47ff5ed04ec99b608a19e041f0e1)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:17.074280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:17.089802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-fae9fce1-1675-4960-9430-60771df94405 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:17.091085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fae9fce1-1675-4960-9430-60771df94405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:17.103295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 938/1883] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:17.104207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9fce1-1675-4960-9430-60771df94405 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:17.117987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9fce1-1675-4960-9430-60771df94405 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:17.124902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00383753-5f87-40a1-a031-d6ba3f25d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:17.125874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00383753-5f87-40a1-a031-d6ba3f25d0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.126156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00383753-5f87-40a1-a031-d6ba3f25d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.128995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00383753-5f87-40a1-a031-d6ba3f25d0fb admin admin] PATH_INFO: `/v3/projects/2cbb77a6f75348aca23363b5f408c490/users/0ce0e0934eb44030b4f70b5552f914d1/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.133677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00383753-5f87-40a1-a031-d6ba3f25d0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbb77a6f75348aca23363b5f408c490, user_id=0ce0e0934eb44030b4f70b5552f914d1, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:17.138151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00383753-5f87-40a1-a031-d6ba3f25d0fb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:17.163441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 939/1884] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:17 2022] PUT /identity/v3/projects/2cbb77a6f75348aca23363b5f408c490/users/0ce0e0934eb44030b4f70b5552f914d1/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:17.163441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00383753-5f87-40a1-a031-d6ba3f25d0fb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:17.163441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-00383753-5f87-40a1-a031-d6ba3f25d0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:17.164608 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730f47ff5ed04ec99b608a19e041f0e1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:17.172779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730f47ff5ed04ec99b608a19e041f0e1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:17.172779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730f47ff5ed04ec99b608a19e041f0e1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:17.192147 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:17.198484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730f47ff5ed04ec99b608a19e041f0e1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:17.212977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ed6beee-d8a6-4b57-85d1-13cdacc22d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730f47ff5ed04ec99b608a19e041f0e1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:17.221386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 946/1885] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:16 2022] DELETE /identity/v3/users/730f47ff5ed04ec99b608a19e041f0e1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:17.226493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc15c-5082-4cd5-aa1c-d2b2d9f8cc63 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.226862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc15c-5082-4cd5-aa1c-d2b2d9f8cc63 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.227223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc15c-5082-4cd5-aa1c-d2b2d9f8cc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.260651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00383753-5f87-40a1-a031-d6ba3f25d0fb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:17.273267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c34dc15c-5082-4cd5-aa1c-d2b2d9f8cc63 None None] MFA Rules not processed for user `0ce0e0934eb44030b4f70b5552f914d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:17.274906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c34dc15c-5082-4cd5-aa1c-d2b2d9f8cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:17.328578 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:17.329219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.329635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.329820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.332199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:17.381424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 947/1886] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:17.382819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab36a2f-ebcd-4c5e-bdd6-eac7824a1589 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.383105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab36a2f-ebcd-4c5e-bdd6-eac7824a1589 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.383382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab36a2f-ebcd-4c5e-bdd6-eac7824a1589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.404943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5ab36a2f-ebcd-4c5e-bdd6-eac7824a1589 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:17.406450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5ab36a2f-ebcd-4c5e-bdd6-eac7824a1589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:17.407103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:17.408666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:17.415664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 948/1887] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:17.416733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab36a2f-ebcd-4c5e-bdd6-eac7824a1589 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:17.425772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 940/1888] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:17.426427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5ab36a2f-ebcd-4c5e-bdd6-eac7824a1589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:17.434957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:17.436523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:17.447889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5bd2d-da99-40e2-80f4-619871a20cd3 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:17.453994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c605f-4019-4bd3-a564-e1ed35be23c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:17.455793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c605f-4019-4bd3-a564-e1ed35be23c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.456740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c605f-4019-4bd3-a564-e1ed35be23c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.457120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c605f-4019-4bd3-a564-e1ed35be23c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.472184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c605f-4019-4bd3-a564-e1ed35be23c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:17.476716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c605f-4019-4bd3-a564-e1ed35be23c7 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:17.512480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 941/1889] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:17.517018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab36a2f-ebcd-4c5e-bdd6-eac7824a1589 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:17.521882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b3d9-e1ea-4c26-9168-2de7e075a1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:17.522977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b3d9-e1ea-4c26-9168-2de7e075a1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.523358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b3d9-e1ea-4c26-9168-2de7e075a1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.523848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b3d9-e1ea-4c26-9168-2de7e075a1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.538405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7b3d9-e1ea-4c26-9168-2de7e075a1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:17.539878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7b3d9-e1ea-4c26-9168-2de7e075a1b9 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:17.553315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 949/1890] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:17.792104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c605f-4019-4bd3-a564-e1ed35be23c7 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:17.794010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-056c605f-4019-4bd3-a564-e1ed35be23c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:17.840100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c605f-4019-4bd3-a564-e1ed35be23c7 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:17.867644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:17.869532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:17.870860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:17.871238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] PATH_INFO: `/v3/projects/400c1ce0825f4cf0b9b1595a3485b35b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:17.873654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=400c1ce0825f4cf0b9b1595a3485b35b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:17.875911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:17.912904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:18.034467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400c1ce0825f4cf0b9b1595a3485b35b', 'request_id': 'req-a551a4d7-5137-4060-95a0-d9c71fc65382'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.044102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400c1ce0825f4cf0b9b1595a3485b35b', 'request_id': 'req-a551a4d7-5137-4060-95a0-d9c71fc65382'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.051266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400c1ce0825f4cf0b9b1595a3485b35b', 'request_id': 'req-a551a4d7-5137-4060-95a0-d9c71fc65382'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.068080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] The token cache is being invalidate because project 400c1ce0825f4cf0b9b1595a3485b35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:18.068574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.069419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a551a4d7-5137-4060-95a0-d9c71fc65382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.076051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b3d9-e1ea-4c26-9168-2de7e075a1b9 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:18.083753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 942/1891] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:17 2022] DELETE /identity/v3/projects/400c1ce0825f4cf0b9b1595a3485b35b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:18.088591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0623-a606-4264-ab2c-db62e7cdcfa2 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:18.089620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0623-a606-4264-ab2c-db62e7cdcfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:18.089620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0623-a606-4264-ab2c-db62e7cdcfa2 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:18.092451 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 943/1892] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:26:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:26:18.093785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b3d9-e1ea-4c26-9168-2de7e075a1b9 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:18.101574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141305f-f981-4498-9781-1b0d99116165 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:18.101964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141305f-f981-4498-9781-1b0d99116165 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:18.102276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141305f-f981-4498-9781-1b0d99116165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:18.156074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d141305f-f981-4498-9781-1b0d99116165 None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:18.157706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d141305f-f981-4498-9781-1b0d99116165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:18.282473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:18.282473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:18.283017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:18.283450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] PATH_INFO: `/v3/users/e96ac0820ae24e7f92b2aeec42d1dca6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:18.284896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96ac0820ae24e7f92b2aeec42d1dca6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:18.288241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:18.296668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:18.329181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 944/1893] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:26:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:18.329181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141305f-f981-4498-9781-1b0d99116165 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:18.339902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d141305f-f981-4498-9781-1b0d99116165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:18.380322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141305f-f981-4498-9781-1b0d99116165 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:18.385471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:18.386305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:18.386606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:18.386910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] PATH_INFO: `/v3/projects/8e006c64a9e9460eb29b82a490357f5c` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:18.388201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e006c64a9e9460eb29b82a490357f5c)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:18.390427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:18.413267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96ac0820ae24e7f92b2aeec42d1dca6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.425744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96ac0820ae24e7f92b2aeec42d1dca6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.427441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96ac0820ae24e7f92b2aeec42d1dca6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.446682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96ac0820ae24e7f92b2aeec42d1dca6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.453736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e006c64a9e9460eb29b82a490357f5c', 'request_id': 'req-346382fd-6caf-4779-b203-56260d7d0dfb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.458922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96ac0820ae24e7f92b2aeec42d1dca6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.462887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e006c64a9e9460eb29b82a490357f5c', 'request_id': 'req-346382fd-6caf-4779-b203-56260d7d0dfb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.470123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 950/1894] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:18 2022] DELETE /identity/v3/users/e96ac0820ae24e7f92b2aeec42d1dca6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:18.470123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:18.470123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:18.476736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e006c64a9e9460eb29b82a490357f5c', 'request_id': 'req-346382fd-6caf-4779-b203-56260d7d0dfb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.495182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] The token cache is being invalidate because project 8e006c64a9e9460eb29b82a490357f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:18.495538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.497975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.501652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 945/1895] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:18 2022] DELETE /identity/v3/projects/8e006c64a9e9460eb29b82a490357f5c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:18.503593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:18.507077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:18.525731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:18.593720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da57e8-228e-48c4-b01b-370338f49415 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:18.603921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:18.604990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:18.606105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:18.616025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] PATH_INFO: `/v3/users/de48f63362644ff9babc349352587225` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:18.618523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de48f63362644ff9babc349352587225)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:18.621044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:18.711387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346382fd-6caf-4779-b203-56260d7d0dfb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:18.716750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de48f63362644ff9babc349352587225'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.727396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de48f63362644ff9babc349352587225'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.728673 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de48f63362644ff9babc349352587225'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.747880 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de48f63362644ff9babc349352587225'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.760037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de48f63362644ff9babc349352587225'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:18.770897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 951/1896] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:18 2022] DELETE /identity/v3/users/de48f63362644ff9babc349352587225 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:18.771852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:18.790902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:18.814330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:18.821294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beb5e3-a15a-4678-92ca-ba7c90a8a033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:18.821294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beb5e3-a15a-4678-92ca-ba7c90a8a033 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:18.822576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beb5e3-a15a-4678-92ca-ba7c90a8a033 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:18.822876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beb5e3-a15a-4678-92ca-ba7c90a8a033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:18.833395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d7beb5e3-a15a-4678-92ca-ba7c90a8a033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:18.857525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beb5e3-a15a-4678-92ca-ba7c90a8a033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:18.859257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beb5e3-a15a-4678-92ca-ba7c90a8a033 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:18.874101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 946/1897] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:18.875404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa893-cbea-405e-98eb-49baf984ac0f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:18.875691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa893-cbea-405e-98eb-49baf984ac0f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:18.875968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa893-cbea-405e-98eb-49baf984ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:18.906479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-295aa893-cbea-405e-98eb-49baf984ac0f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:18.907414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-295aa893-cbea-405e-98eb-49baf984ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:18.916940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f4897-99ed-439b-917e-6c48f7bffc52 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:18.918308 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 947/1898] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:18.925061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:18.925791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:18.926110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:18.926343 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] PATH_INFO: `/v3/users/f2ad357025754d19b867c0c95837dfbd` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:18.927964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ad357025754d19b867c0c95837dfbd)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:18.930017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:18.946235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa893-cbea-405e-98eb-49baf984ac0f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:18.947709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-295aa893-cbea-405e-98eb-49baf984ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:19.003964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ad357025754d19b867c0c95837dfbd'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.015494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ad357025754d19b867c0c95837dfbd'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.016578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ad357025754d19b867c0c95837dfbd'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.039693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ad357025754d19b867c0c95837dfbd'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.052398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ad357025754d19b867c0c95837dfbd'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.054758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa893-cbea-405e-98eb-49baf984ac0f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:19.059412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cca54-ad0e-414b-a49d-0a1997f2e94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:19.060252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cca54-ad0e-414b-a49d-0a1997f2e94d service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:19.063430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cca54-ad0e-414b-a49d-0a1997f2e94d service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:19.063628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 952/1899] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:18 2022] DELETE /identity/v3/users/f2ad357025754d19b867c0c95837dfbd => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:19.064525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cca54-ad0e-414b-a49d-0a1997f2e94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:19.072619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fa5cca54-ad0e-414b-a49d-0a1997f2e94d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:19.103651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cca54-ad0e-414b-a49d-0a1997f2e94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:19.108273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cca54-ad0e-414b-a49d-0a1997f2e94d service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:19.125115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 948/1900] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:19.167304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:19.169141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:19.279906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f585-0b96-46c1-b2c6-0dab6e5b346a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:19.294863 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:19.295723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:19.296333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:19.296333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] PATH_INFO: `/v3/projects/e1556b7d449f48db89d3128d92813d06` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:19.300942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1556b7d449f48db89d3128d92813d06)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:19.310444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:19.343383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:19.373279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1556b7d449f48db89d3128d92813d06', 'request_id': 'req-9850d74f-3f2f-4266-b522-6e393fd1bc19'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.383787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1556b7d449f48db89d3128d92813d06', 'request_id': 'req-9850d74f-3f2f-4266-b522-6e393fd1bc19'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.392706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1556b7d449f48db89d3128d92813d06', 'request_id': 'req-9850d74f-3f2f-4266-b522-6e393fd1bc19'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.425366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] The token cache is being invalidate because project e1556b7d449f48db89d3128d92813d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:19.425366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.425366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9850d74f-3f2f-4266-b522-6e393fd1bc19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.425366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 953/1901] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:19 2022] DELETE /identity/v3/projects/e1556b7d449f48db89d3128d92813d06 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:19.428868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086e1ac-8ff2-4db6-99c9-ca5cbd1857d6 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:19.429309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086e1ac-8ff2-4db6-99c9-ca5cbd1857d6 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:19.429646 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086e1ac-8ff2-4db6-99c9-ca5cbd1857d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:19.451190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-7086e1ac-8ff2-4db6-99c9-ca5cbd1857d6 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:19.452413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7086e1ac-8ff2-4db6-99c9-ca5cbd1857d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:19.495366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:19.541326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 949/1902] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:19.549072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a35c8-14fa-4268-b651-013b12968200 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:19.549505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a35c8-14fa-4268-b651-013b12968200 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:19.550855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a35c8-14fa-4268-b651-013b12968200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:19.573881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-ce1a35c8-14fa-4268-b651-013b12968200 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:19.575195 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ce1a35c8-14fa-4268-b651-013b12968200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:19.592957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 954/1903] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:19.598888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086e1ac-8ff2-4db6-99c9-ca5cbd1857d6 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:19.615062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086e1ac-8ff2-4db6-99c9-ca5cbd1857d6 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:19.621853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a35c8-14fa-4268-b651-013b12968200 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:19.623944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ce1a35c8-14fa-4268-b651-013b12968200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:19.624068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff28b-85ac-4194-9641-017a2fd3917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:19.624748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff28b-85ac-4194-9641-017a2fd3917d admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:19.625595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff28b-85ac-4194-9641-017a2fd3917d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:19.625883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff28b-85ac-4194-9641-017a2fd3917d admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:19.626558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff28b-85ac-4194-9641-017a2fd3917d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:19.626868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff28b-85ac-4194-9641-017a2fd3917d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:19.628779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff28b-85ac-4194-9641-017a2fd3917d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:19.643142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a35c8-14fa-4268-b651-013b12968200 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:19.652634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:19.653573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:19.653848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:19.654697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] PATH_INFO: `/v3/projects/ab7b2808dbe34a63b02bf87ec5a05b2c` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:19.655565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 950/1904] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:26:19.660389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7b2808dbe34a63b02bf87ec5a05b2c)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:19.663601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:19.664542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff28b-85ac-4194-9641-017a2fd3917d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:19.689647 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff28b-85ac-4194-9641-017a2fd3917d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:19.696007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dfdaa-87f5-40f4-b598-d8798d9ce48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:19.696725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dfdaa-87f5-40f4-b598-d8798d9ce48b admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:19.697190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dfdaa-87f5-40f4-b598-d8798d9ce48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:19.697510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dfdaa-87f5-40f4-b598-d8798d9ce48b admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:19.698470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dfdaa-87f5-40f4-b598-d8798d9ce48b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:19.700890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dfdaa-87f5-40f4-b598-d8798d9ce48b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:19.739799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 951/1905] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:19 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:19.740995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dfdaa-87f5-40f4-b598-d8798d9ce48b admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:19.743424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d90dfdaa-87f5-40f4-b598-d8798d9ce48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:19.747126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7b2808dbe34a63b02bf87ec5a05b2c', 'request_id': 'req-8a08d4da-be61-44b1-b011-5cf41e05845f'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.754779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7b2808dbe34a63b02bf87ec5a05b2c', 'request_id': 'req-8a08d4da-be61-44b1-b011-5cf41e05845f'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.760678 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7b2808dbe34a63b02bf87ec5a05b2c', 'request_id': 'req-8a08d4da-be61-44b1-b011-5cf41e05845f'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.773452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] The token cache is being invalidate because project ab7b2808dbe34a63b02bf87ec5a05b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:19.773745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.774421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.775933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 955/1906] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:19 2022] DELETE /identity/v3/projects/ab7b2808dbe34a63b02bf87ec5a05b2c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:19.776678 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:19.778002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:19.826287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dfdaa-87f5-40f4-b598-d8798d9ce48b admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:19.837539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:19.839498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:19.839787 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:19.840078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] PATH_INFO: `/v3/projects/d72af813f83041d3be45a253e38878f3` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:19.843324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72af813f83041d3be45a253e38878f3)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:19.845339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:19.891611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08d4da-be61-44b1-b011-5cf41e05845f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:19.910424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72af813f83041d3be45a253e38878f3', 'request_id': 'req-ab230b9c-2a3e-4082-b560-e6c810649235'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.920729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72af813f83041d3be45a253e38878f3', 'request_id': 'req-ab230b9c-2a3e-4082-b560-e6c810649235'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.937816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72af813f83041d3be45a253e38878f3', 'request_id': 'req-ab230b9c-2a3e-4082-b560-e6c810649235'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.957618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] The token cache is being invalidate because project d72af813f83041d3be45a253e38878f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:19.957927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.958687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ab230b9c-2a3e-4082-b560-e6c810649235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:19.959818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:19.964159 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 952/1907] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:19 2022] DELETE /identity/v3/projects/d72af813f83041d3be45a253e38878f3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:19.965947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5079de-7ab9-420e-a8ea-1f3e6d296bc6 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:19.967067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5079de-7ab9-420e-a8ea-1f3e6d296bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:19.967787 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5079de-7ab9-420e-a8ea-1f3e6d296bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:19.995887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-fb5079de-7ab9-420e-a8ea-1f3e6d296bc6 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:19.997406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fb5079de-7ab9-420e-a8ea-1f3e6d296bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:19.998942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffefff-e734-4efa-aeb9-1b660acc769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.000062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffefff-e734-4efa-aeb9-1b660acc769d admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.001408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffefff-e734-4efa-aeb9-1b660acc769d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.002105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffefff-e734-4efa-aeb9-1b660acc769d admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.007082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 953/1908] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:20.014608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5079de-7ab9-420e-a8ea-1f3e6d296bc6 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.014608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fb5079de-7ab9-420e-a8ea-1f3e6d296bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.014894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffefff-e734-4efa-aeb9-1b660acc769d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.017292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffefff-e734-4efa-aeb9-1b660acc769d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.033504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5079de-7ab9-420e-a8ea-1f3e6d296bc6 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.033504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.033504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.033504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.033835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] PATH_INFO: `/v3/users/0ce0e0934eb44030b4f70b5552f914d1` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.033835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce0e0934eb44030b4f70b5552f914d1)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.033835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.048914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 956/1909] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:19 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:20.050361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c9d0a-1dd5-4cf8-97b3-98941df7bc2c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.050624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c9d0a-1dd5-4cf8-97b3-98941df7bc2c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.051337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c9d0a-1dd5-4cf8-97b3-98941df7bc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.056094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:20.075521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b32c9d0a-1dd5-4cf8-97b3-98941df7bc2c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:20.076926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b32c9d0a-1dd5-4cf8-97b3-98941df7bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.085797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 957/1910] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:20.090534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c9d0a-1dd5-4cf8-97b3-98941df7bc2c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.091907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b32c9d0a-1dd5-4cf8-97b3-98941df7bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.099714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce0e0934eb44030b4f70b5552f914d1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.105170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c9d0a-1dd5-4cf8-97b3-98941df7bc2c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.109187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce0e0934eb44030b4f70b5552f914d1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.110288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce0e0934eb44030b4f70b5552f914d1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.112733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed41909-bd2f-4502-a349-08233402b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.113443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed41909-bd2f-4502-a349-08233402b5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.113728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed41909-bd2f-4502-a349-08233402b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.114001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed41909-bd2f-4502-a349-08233402b5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.114710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed41909-bd2f-4502-a349-08233402b5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.116888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed41909-bd2f-4502-a349-08233402b5fb admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.125001 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce0e0934eb44030b4f70b5552f914d1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.127448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 958/1911] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:20.130959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed41909-bd2f-4502-a349-08233402b5fb admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.134552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9ed41909-bd2f-4502-a349-08233402b5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.134870 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce0e0934eb44030b4f70b5552f914d1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.143188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 954/1912] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:20 2022] DELETE /identity/v3/users/0ce0e0934eb44030b4f70b5552f914d1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:20.144841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.146907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.154024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed41909-bd2f-4502-a349-08233402b5fb admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.278498 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065b064-4992-4928-829c-ea12ce92a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.279314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065b064-4992-4928-829c-ea12ce92a3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.279454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065b064-4992-4928-829c-ea12ce92a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.279618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065b064-4992-4928-829c-ea12ce92a3f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.280286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065b064-4992-4928-829c-ea12ce92a3f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:20.280604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065b064-4992-4928-829c-ea12ce92a3f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.282978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065b064-4992-4928-829c-ea12ce92a3f6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.301541 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbabcf-6748-48fa-a8c2-799ce6e989be admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.306445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 959/1913] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:20.307624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065b064-4992-4928-829c-ea12ce92a3f6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.307744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648006fb-219d-4ad2-a5e5-3b5f994adab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.308531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648006fb-219d-4ad2-a5e5-3b5f994adab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.308662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648006fb-219d-4ad2-a5e5-3b5f994adab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.308923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648006fb-219d-4ad2-a5e5-3b5f994adab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.309677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648006fb-219d-4ad2-a5e5-3b5f994adab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.311860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648006fb-219d-4ad2-a5e5-3b5f994adab9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.319143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065b064-4992-4928-829c-ea12ce92a3f6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.324384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ac397-e97c-4243-8767-d1dbaa8fabec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.328381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 955/1914] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:20.328522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac397-e97c-4243-8767-d1dbaa8fabec admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.328522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac397-e97c-4243-8767-d1dbaa8fabec admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.328522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac397-e97c-4243-8767-d1dbaa8fabec admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.328522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ac397-e97c-4243-8767-d1dbaa8fabec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.328522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ac397-e97c-4243-8767-d1dbaa8fabec admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.329575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648006fb-219d-4ad2-a5e5-3b5f994adab9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.343638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648006fb-219d-4ad2-a5e5-3b5f994adab9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.349785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffe7e6-f1b8-4142-8af2-2bbe1bcd07ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.350694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffe7e6-f1b8-4142-8af2-2bbe1bcd07ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.351014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffe7e6-f1b8-4142-8af2-2bbe1bcd07ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.351729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffe7e6-f1b8-4142-8af2-2bbe1bcd07ec admin admin] PATH_INFO: `/v3/projects/a952dea9ed2b4126a294e987c670741d/users/a2effa79a8364da0a7e5c5d0266e4bb1/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.362861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 960/1915] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:20 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:20.367088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ac397-e97c-4243-8767-d1dbaa8fabec admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.374588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffe7e6-f1b8-4142-8af2-2bbe1bcd07ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a952dea9ed2b4126a294e987c670741d, user_id=a2effa79a8364da0a7e5c5d0266e4bb1, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.377362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffe7e6-f1b8-4142-8af2-2bbe1bcd07ec admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.400734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 956/1916] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:20 2022] PUT /identity/v3/projects/a952dea9ed2b4126a294e987c670741d/users/a2effa79a8364da0a7e5c5d0266e4bb1/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:20.413218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e208d-13ff-4328-bd67-5179e5d76fb1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.413539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e208d-13ff-4328-bd67-5179e5d76fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.414219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e208d-13ff-4328-bd67-5179e5d76fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.502647 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-c91e208d-13ff-4328-bd67-5179e5d76fb1 None None] MFA Rules not processed for user `a2effa79a8364da0a7e5c5d0266e4bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:20.505484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c91e208d-13ff-4328-bd67-5179e5d76fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.514586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ac397-e97c-4243-8767-d1dbaa8fabec admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.550327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:20.598359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b315be-a996-4368-8703-12460c20067a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.599371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b315be-a996-4368-8703-12460c20067a admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.600848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b315be-a996-4368-8703-12460c20067a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.600848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b315be-a996-4368-8703-12460c20067a admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.600848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b315be-a996-4368-8703-12460c20067a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.602548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b315be-a996-4368-8703-12460c20067a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.627930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:20.650782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 957/1917] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:20.652539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e208d-13ff-4328-bd67-5179e5d76fb1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.656124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c91e208d-13ff-4328-bd67-5179e5d76fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.661042 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 961/1918] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:20 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:20.661042 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b315be-a996-4368-8703-12460c20067a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.680095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b315be-a996-4368-8703-12460c20067a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.685465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e208d-13ff-4328-bd67-5179e5d76fb1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.687205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daf933-6f9f-45dd-942d-58c24410d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.689331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf933-6f9f-45dd-942d-58c24410d8eb admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.690999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf933-6f9f-45dd-942d-58c24410d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.691635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf933-6f9f-45dd-942d-58c24410d8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.692567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daf933-6f9f-45dd-942d-58c24410d8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.696137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daf933-6f9f-45dd-942d-58c24410d8eb admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.704461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.705142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.705479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.705761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] PATH_INFO: `/v3/projects/2cbb77a6f75348aca23363b5f408c490` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.707258 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbb77a6f75348aca23363b5f408c490)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.709954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.758233 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 962/1919] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:20 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:20.759262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daf933-6f9f-45dd-942d-58c24410d8eb admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.805585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbb77a6f75348aca23363b5f408c490', 'request_id': 'req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.814534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbb77a6f75348aca23363b5f408c490', 'request_id': 'req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.822477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbb77a6f75348aca23363b5f408c490', 'request_id': 'req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.836813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daf933-6f9f-45dd-942d-58c24410d8eb admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.837150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] The token cache is being invalidate because project 2cbb77a6f75348aca23363b5f408c490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:20.837463 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.838202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:20.843020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 958/1920] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:20 2022] DELETE /identity/v3/projects/2cbb77a6f75348aca23363b5f408c490 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:20.843020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.843020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.902177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1086f6c-e52a-4f11-a926-46015a4a1ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.902811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1086f6c-e52a-4f11-a926-46015a4a1ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.903092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1086f6c-e52a-4f11-a926-46015a4a1ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.903375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1086f6c-e52a-4f11-a926-46015a4a1ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.904013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1086f6c-e52a-4f11-a926-46015a4a1ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.905643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1086f6c-e52a-4f11-a926-46015a4a1ff7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.911157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd10cda-c753-4ac3-9aa7-7cbf2c49064f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.916696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef027973-9dc4-4cfb-9308-85e6d6ae19e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.917376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef027973-9dc4-4cfb-9308-85e6d6ae19e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.917665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef027973-9dc4-4cfb-9308-85e6d6ae19e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.917952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef027973-9dc4-4cfb-9308-85e6d6ae19e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.918594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef027973-9dc4-4cfb-9308-85e6d6ae19e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.920700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef027973-9dc4-4cfb-9308-85e6d6ae19e5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.924585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 963/1921] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:20.924585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7d179-61ae-48c2-9902-c1fc2ed89660 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.924585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7d179-61ae-48c2-9902-c1fc2ed89660 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.924585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7d179-61ae-48c2-9902-c1fc2ed89660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.949309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 959/1922] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:20 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:20.949309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef027973-9dc4-4cfb-9308-85e6d6ae19e5 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.949309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ef027973-9dc4-4cfb-9308-85e6d6ae19e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.960913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-23a7d179-61ae-48c2-9902-c1fc2ed89660 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:20.962188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-23a7d179-61ae-48c2-9902-c1fc2ed89660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:20.962736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef027973-9dc4-4cfb-9308-85e6d6ae19e5 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.968396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184d970-9e93-4557-a769-f27f2a245c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.969166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184d970-9e93-4557-a769-f27f2a245c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.969485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184d970-9e93-4557-a769-f27f2a245c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.969766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184d970-9e93-4557-a769-f27f2a245c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.970544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184d970-9e93-4557-a769-f27f2a245c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:20.972614 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184d970-9e93-4557-a769-f27f2a245c8e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:20.974116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 964/1923] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:20.975180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7d179-61ae-48c2-9902-c1fc2ed89660 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:20.985545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7d179-61ae-48c2-9902-c1fc2ed89660 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:20.986872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 960/1924] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:20.988779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba452e-ec47-43b6-a02f-8ebed25d6b3a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.989065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba452e-ec47-43b6-a02f-8ebed25d6b3a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.989594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba452e-ec47-43b6-a02f-8ebed25d6b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.996413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca91d7-7dc4-4258-ab13-f6925c4b84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:20.997109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca91d7-7dc4-4258-ab13-f6925c4b84ec admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:20.997565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca91d7-7dc4-4258-ab13-f6925c4b84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:20.997848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca91d7-7dc4-4258-ab13-f6925c4b84ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:20.998514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca91d7-7dc4-4258-ab13-f6925c4b84ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.000190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca91d7-7dc4-4258-ab13-f6925c4b84ec admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.011183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 965/1925] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:21.013055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca91d7-7dc4-4258-ab13-f6925c4b84ec admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.013310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-eaba452e-ec47-43b6-a02f-8ebed25d6b3a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:21.014639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-eaba452e-ec47-43b6-a02f-8ebed25d6b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:21.023192 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 961/1926] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:21.024055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba452e-ec47-43b6-a02f-8ebed25d6b3a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.024186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca91d7-7dc4-4258-ab13-f6925c4b84ec admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.028848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdebeef-3294-4d50-8e3a-943d724d1b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.029541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdebeef-3294-4d50-8e3a-943d724d1b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.029824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdebeef-3294-4d50-8e3a-943d724d1b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.030101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdebeef-3294-4d50-8e3a-943d724d1b54 admin admin] PATH_INFO: `/v3/projects/d4bde12101764fde9fba354fe5c41a60/users/aa0e17a3f6ff4145984ce584d8dc0ca9/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.034501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba452e-ec47-43b6-a02f-8ebed25d6b3a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.039120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b00ae-56b1-4e5f-9e9f-014f788b6935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.039717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b00ae-56b1-4e5f-9e9f-014f788b6935 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.039999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b00ae-56b1-4e5f-9e9f-014f788b6935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.040269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b00ae-56b1-4e5f-9e9f-014f788b6935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.040934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b00ae-56b1-4e5f-9e9f-014f788b6935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.043177 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b00ae-56b1-4e5f-9e9f-014f788b6935 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.046243 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdebeef-3294-4d50-8e3a-943d724d1b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4bde12101764fde9fba354fe5c41a60, user_id=aa0e17a3f6ff4145984ce584d8dc0ca9, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.049765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdebeef-3294-4d50-8e3a-943d724d1b54 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.055369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 962/1927] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:21.056526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b00ae-56b1-4e5f-9e9f-014f788b6935 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.061758 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:21.069425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b00ae-56b1-4e5f-9e9f-014f788b6935 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.077438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 966/1928] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:21 2022] PUT /identity/v3/projects/d4bde12101764fde9fba354fe5c41a60/users/aa0e17a3f6ff4145984ce584d8dc0ca9/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:21.078241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdebeef-3294-4d50-8e3a-943d724d1b54 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.123116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:21.149785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b632181-d0f4-4662-8304-16e0e51f68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.151012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632181-d0f4-4662-8304-16e0e51f68d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.151516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632181-d0f4-4662-8304-16e0e51f68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.152059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632181-d0f4-4662-8304-16e0e51f68d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.153309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632181-d0f4-4662-8304-16e0e51f68d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:21.153877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632181-d0f4-4662-8304-16e0e51f68d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.156900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632181-d0f4-4662-8304-16e0e51f68d1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.177933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdebeef-3294-4d50-8e3a-943d724d1b54 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.181305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 963/1929] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:21.182603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293132d-897a-4389-8db9-ce4b3938bd5e None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.182889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293132d-897a-4389-8db9-ce4b3938bd5e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.183924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293132d-897a-4389-8db9-ce4b3938bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.187341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8efdec-6783-495a-a7f8-4ed4931b8161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.188305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8efdec-6783-495a-a7f8-4ed4931b8161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.188723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8efdec-6783-495a-a7f8-4ed4931b8161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.189004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8efdec-6783-495a-a7f8-4ed4931b8161 admin admin] PATH_INFO: `/v3/projects/0205400e8b5540bf855dba6b4fcc85e4/users/a9539d0018594f9abbecc11c8a47415a/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.205527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8efdec-6783-495a-a7f8-4ed4931b8161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0205400e8b5540bf855dba6b4fcc85e4, user_id=a9539d0018594f9abbecc11c8a47415a, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.209710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8efdec-6783-495a-a7f8-4ed4931b8161 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.217563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-f293132d-897a-4389-8db9-ce4b3938bd5e None None] MFA Rules not processed for user `aa0e17a3f6ff4145984ce584d8dc0ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:21.219020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f293132d-897a-4389-8db9-ce4b3938bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:21.242456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 967/1930] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:21 2022] PUT /identity/v3/projects/0205400e8b5540bf855dba6b4fcc85e4/users/a9539d0018594f9abbecc11c8a47415a/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:21.242456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8efdec-6783-495a-a7f8-4ed4931b8161 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.318637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 964/1931] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:21.320638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3cbf7-a94b-4a23-b6ae-700c5cca4743 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.321149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3cbf7-a94b-4a23-b6ae-700c5cca4743 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.321686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3cbf7-a94b-4a23-b6ae-700c5cca4743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.322124 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8efdec-6783-495a-a7f8-4ed4931b8161 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.327073 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdbb2-6c8f-49c4-b331-bae27bdc36c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.327800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdbb2-6c8f-49c4-b331-bae27bdc36c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.328103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdbb2-6c8f-49c4-b331-bae27bdc36c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.328286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdbb2-6c8f-49c4-b331-bae27bdc36c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.328891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbdbb2-6c8f-49c4-b331-bae27bdc36c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.332498 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbdbb2-6c8f-49c4-b331-bae27bdc36c8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.357390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-c8a3cbf7-a94b-4a23-b6ae-700c5cca4743 None None] MFA Rules not processed for user `a9539d0018594f9abbecc11c8a47415a`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:21.358603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c8a3cbf7-a94b-4a23-b6ae-700c5cca4743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:21.366756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 968/1932] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:21 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:21.366756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdbb2-6c8f-49c4-b331-bae27bdc36c8 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.439325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdbb2-6c8f-49c4-b331-bae27bdc36c8 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.444968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0792-398a-481c-89ba-e5c42a2249c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.445842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0792-398a-481c-89ba-e5c42a2249c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.446137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0792-398a-481c-89ba-e5c42a2249c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.446421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0792-398a-481c-89ba-e5c42a2249c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.447433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b0792-398a-481c-89ba-e5c42a2249c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.449282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b0792-398a-481c-89ba-e5c42a2249c6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.468204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:21.487379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 965/1933] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:21.490193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 969/1934] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:21 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:21.496208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3cbf7-a94b-4a23-b6ae-700c5cca4743 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.510991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3cbf7-a94b-4a23-b6ae-700c5cca4743 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.517463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0792-398a-481c-89ba-e5c42a2249c6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.599636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0792-398a-481c-89ba-e5c42a2249c6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.615377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6d33a-56d5-4c0c-a149-44c8685beab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.616022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6d33a-56d5-4c0c-a149-44c8685beab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.616310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6d33a-56d5-4c0c-a149-44c8685beab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.616588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6d33a-56d5-4c0c-a149-44c8685beab9 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.617501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6d33a-56d5-4c0c-a149-44c8685beab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.619532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6d33a-56d5-4c0c-a149-44c8685beab9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.631840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:21.649413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd1fc-a2be-4a12-a874-1c06375184ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.650459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd1fc-a2be-4a12-a874-1c06375184ae admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.651073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd1fc-a2be-4a12-a874-1c06375184ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.651560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd1fc-a2be-4a12-a874-1c06375184ae admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.653337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfd1fc-a2be-4a12-a874-1c06375184ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.653664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 970/1935] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:21 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:21.654585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6d33a-56d5-4c0c-a149-44c8685beab9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.657103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfd1fc-a2be-4a12-a874-1c06375184ae admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.683710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6d33a-56d5-4c0c-a149-44c8685beab9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.691676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e71061-2d1c-4b09-8a3b-ca37e1938361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.692365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e71061-2d1c-4b09-8a3b-ca37e1938361 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.692658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e71061-2d1c-4b09-8a3b-ca37e1938361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.692974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e71061-2d1c-4b09-8a3b-ca37e1938361 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.693893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e71061-2d1c-4b09-8a3b-ca37e1938361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.696237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e71061-2d1c-4b09-8a3b-ca37e1938361 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.698926 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 966/1936] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:21 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:21.700108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd1fc-a2be-4a12-a874-1c06375184ae admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.720270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd1fc-a2be-4a12-a874-1c06375184ae admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.728494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f34ec-0809-4b2d-8131-cc85a31a2df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.729946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f34ec-0809-4b2d-8131-cc85a31a2df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.730355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f34ec-0809-4b2d-8131-cc85a31a2df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.730631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f34ec-0809-4b2d-8131-cc85a31a2df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.731526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f34ec-0809-4b2d-8131-cc85a31a2df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.745774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f34ec-0809-4b2d-8131-cc85a31a2df7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.781757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 967/1937] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:21.787954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 971/1938] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:21 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:21.791711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f34ec-0809-4b2d-8131-cc85a31a2df7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.805621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e71061-2d1c-4b09-8a3b-ca37e1938361 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:21.827709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f34ec-0809-4b2d-8131-cc85a31a2df7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.980501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e54e0-cc38-4463-bcb2-608a177f492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.981146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e54e0-cc38-4463-bcb2-608a177f492b admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.981458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e54e0-cc38-4463-bcb2-608a177f492b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.981740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e54e0-cc38-4463-bcb2-608a177f492b admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:21.982406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e54e0-cc38-4463-bcb2-608a177f492b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:21.989734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e71061-2d1c-4b09-8a3b-ca37e1938361 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:21.990037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e54e0-cc38-4463-bcb2-608a177f492b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:21.995873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99344a-7bed-473b-841b-2c035e29efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:21.996579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99344a-7bed-473b-841b-2c035e29efaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:21.996864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99344a-7bed-473b-841b-2c035e29efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:21.997143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99344a-7bed-473b-841b-2c035e29efaf admin admin] PATH_INFO: `/v3/projects/7fc5eb3b28d740e186f5e3f20273dada/users/7664329ba3544fd38f988bb6b1268bc1/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.020037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 968/1939] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:22.024511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e54e0-cc38-4463-bcb2-608a177f492b admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.024864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99344a-7bed-473b-841b-2c035e29efaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc5eb3b28d740e186f5e3f20273dada, user_id=7664329ba3544fd38f988bb6b1268bc1, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.028240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99344a-7bed-473b-841b-2c035e29efaf admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.049557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 972/1940] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:21 2022] PUT /identity/v3/projects/7fc5eb3b28d740e186f5e3f20273dada/users/7664329ba3544fd38f988bb6b1268bc1/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:22.052424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99344a-7bed-473b-841b-2c035e29efaf admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.054095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e54e0-cc38-4463-bcb2-608a177f492b admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.144261 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61784553-ec02-4b3f-b09a-a9af4b61414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.145071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61784553-ec02-4b3f-b09a-a9af4b61414c admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.145477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61784553-ec02-4b3f-b09a-a9af4b61414c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.145763 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61784553-ec02-4b3f-b09a-a9af4b61414c admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.146487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61784553-ec02-4b3f-b09a-a9af4b61414c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.148382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61784553-ec02-4b3f-b09a-a9af4b61414c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.179269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:22.183941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 969/1941] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:22 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:22.186032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61784553-ec02-4b3f-b09a-a9af4b61414c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.202842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61784553-ec02-4b3f-b09a-a9af4b61414c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.204503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99344a-7bed-473b-841b-2c035e29efaf admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.209128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30439966-c69e-42ae-af24-a5e5e1f73130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.209878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30439966-c69e-42ae-af24-a5e5e1f73130 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.210675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc951a-f882-4edf-bb13-578596eda208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.211060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30439966-c69e-42ae-af24-a5e5e1f73130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.211475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30439966-c69e-42ae-af24-a5e5e1f73130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.212103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc951a-f882-4edf-bb13-578596eda208 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.212235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30439966-c69e-42ae-af24-a5e5e1f73130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.212865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc951a-f882-4edf-bb13-578596eda208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.213508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc951a-f882-4edf-bb13-578596eda208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.214104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30439966-c69e-42ae-af24-a5e5e1f73130 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.214524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc951a-f882-4edf-bb13-578596eda208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.217097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc951a-f882-4edf-bb13-578596eda208 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.227263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 970/1942] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:22.232244 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30439966-c69e-42ae-af24-a5e5e1f73130 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.236302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 973/1943] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:22.237985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc951a-f882-4edf-bb13-578596eda208 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.249482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30439966-c69e-42ae-af24-a5e5e1f73130 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.258219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64725508-bdce-4aba-ae08-f0198b97d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.258370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725508-bdce-4aba-ae08-f0198b97d3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.258717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725508-bdce-4aba-ae08-f0198b97d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.259089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725508-bdce-4aba-ae08-f0198b97d3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.260401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64725508-bdce-4aba-ae08-f0198b97d3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.262335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64725508-bdce-4aba-ae08-f0198b97d3f6 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.264521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc951a-f882-4edf-bb13-578596eda208 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.274046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f04843-33ec-4ea8-a570-fa98ac082459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.274688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f04843-33ec-4ea8-a570-fa98ac082459 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.274971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f04843-33ec-4ea8-a570-fa98ac082459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.275250 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f04843-33ec-4ea8-a570-fa98ac082459 admin admin] PATH_INFO: `/v3/projects/7fc5eb3b28d740e186f5e3f20273dada/users/7664329ba3544fd38f988bb6b1268bc1/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.280708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 971/1944] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:22.280939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f04843-33ec-4ea8-a570-fa98ac082459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc5eb3b28d740e186f5e3f20273dada, user_id=7664329ba3544fd38f988bb6b1268bc1, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.281208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64725508-bdce-4aba-ae08-f0198b97d3f6 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.283868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f04843-33ec-4ea8-a570-fa98ac082459 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.293426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64725508-bdce-4aba-ae08-f0198b97d3f6 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.298636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad6d35-a7a6-4ce3-80a4-c5cf1f582de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.299429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6d35-a7a6-4ce3-80a4-c5cf1f582de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.300375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6d35-a7a6-4ce3-80a4-c5cf1f582de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.300813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6d35-a7a6-4ce3-80a4-c5cf1f582de5 admin admin] PATH_INFO: `/v3/projects/8877e0052e134a9faf26cf3136287084/users/c2d7dcf487214272a87fa8f21d5b4504/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.310921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 974/1945] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:22 2022] PUT /identity/v3/projects/7fc5eb3b28d740e186f5e3f20273dada/users/7664329ba3544fd38f988bb6b1268bc1/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:22.311534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f04843-33ec-4ea8-a570-fa98ac082459 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.343914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad6d35-a7a6-4ce3-80a4-c5cf1f582de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8877e0052e134a9faf26cf3136287084, user_id=c2d7dcf487214272a87fa8f21d5b4504, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.349582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad6d35-a7a6-4ce3-80a4-c5cf1f582de5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.394896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 972/1946] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:22 2022] PUT /identity/v3/projects/8877e0052e134a9faf26cf3136287084/users/c2d7dcf487214272a87fa8f21d5b4504/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:22.396840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9852-25a5-4e9f-9419-53ceaca3e8a5 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.397371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9852-25a5-4e9f-9419-53ceaca3e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.397822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9852-25a5-4e9f-9419-53ceaca3e8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.453745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:22.470413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f04843-33ec-4ea8-a570-fa98ac082459 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.472567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-822f9852-25a5-4e9f-9419-53ceaca3e8a5 None None] MFA Rules not processed for user `7664329ba3544fd38f988bb6b1268bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:22.481014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-822f9852-25a5-4e9f-9419-53ceaca3e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:22.588635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd19049-8cfd-481d-b2f5-9d5d3e156171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.589366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd19049-8cfd-481d-b2f5-9d5d3e156171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.589657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd19049-8cfd-481d-b2f5-9d5d3e156171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.589974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd19049-8cfd-481d-b2f5-9d5d3e156171 admin admin] PATH_INFO: `/v3/projects/06d8c5eafe7441d5abf4f03e4f21500a/users/d08485b78e9d4b7da36c5d35cab574ed/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.607725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd19049-8cfd-481d-b2f5-9d5d3e156171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d8c5eafe7441d5abf4f03e4f21500a, user_id=d08485b78e9d4b7da36c5d35cab574ed, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.608922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 973/1947] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:22.610401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d063-402a-4c17-8a7a-9a065b796e3d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.610755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd19049-8cfd-481d-b2f5-9d5d3e156171 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.610939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d063-402a-4c17-8a7a-9a065b796e3d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.611217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d063-402a-4c17-8a7a-9a065b796e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.629046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 975/1948] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:22 2022] PUT /identity/v3/projects/06d8c5eafe7441d5abf4f03e4f21500a/users/d08485b78e9d4b7da36c5d35cab574ed/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:22.629994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd19049-8cfd-481d-b2f5-9d5d3e156171 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.631750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ddd19049-8cfd-481d-b2f5-9d5d3e156171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:22.647413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a663d063-402a-4c17-8a7a-9a065b796e3d None None] MFA Rules not processed for user `c2d7dcf487214272a87fa8f21d5b4504`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:22.648650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a663d063-402a-4c17-8a7a-9a065b796e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:22.703685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd19049-8cfd-481d-b2f5-9d5d3e156171 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.709203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19d52-f1b7-4711-8c5e-31d0fcc6c86b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.710190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19d52-f1b7-4711-8c5e-31d0fcc6c86b service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.710640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19d52-f1b7-4711-8c5e-31d0fcc6c86b service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.711079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19d52-f1b7-4711-8c5e-31d0fcc6c86b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.725455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:22.738443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 974/1949] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:22.739305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d063-402a-4c17-8a7a-9a065b796e3d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.792957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c19d52-f1b7-4711-8c5e-31d0fcc6c86b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.794461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c19d52-f1b7-4711-8c5e-31d0fcc6c86b service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.807353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 976/1950] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:22.808205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19d52-f1b7-4711-8c5e-31d0fcc6c86b service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.809634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d063-402a-4c17-8a7a-9a065b796e3d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.815209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d622510-0bf7-4abf-ad1d-f9833166df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.816797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d622510-0bf7-4abf-ad1d-f9833166df4e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.817086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d622510-0bf7-4abf-ad1d-f9833166df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.817404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d622510-0bf7-4abf-ad1d-f9833166df4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.818074 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d622510-0bf7-4abf-ad1d-f9833166df4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.819466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19d52-f1b7-4711-8c5e-31d0fcc6c86b service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.819698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d622510-0bf7-4abf-ad1d-f9833166df4e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.825867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a124401-6f08-4f0e-8fa4-f144f316e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.826530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a124401-6f08-4f0e-8fa4-f144f316e3db admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.827389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a124401-6f08-4f0e-8fa4-f144f316e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.827672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a124401-6f08-4f0e-8fa4-f144f316e3db admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.828318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a124401-6f08-4f0e-8fa4-f144f316e3db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.830438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a124401-6f08-4f0e-8fa4-f144f316e3db admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.832249 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 975/1951] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:22.836534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d622510-0bf7-4abf-ad1d-f9833166df4e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.851587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d622510-0bf7-4abf-ad1d-f9833166df4e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:22.860658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bda574-9184-4fc5-9e9f-b2155553c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:22.861865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bda574-9184-4fc5-9e9f-b2155553c4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.863386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bda574-9184-4fc5-9e9f-b2155553c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.863668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bda574-9184-4fc5-9e9f-b2155553c4f9 admin admin] PATH_INFO: `/v3/projects/06d8c5eafe7441d5abf4f03e4f21500a/users/d08485b78e9d4b7da36c5d35cab574ed/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.868280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 977/1952] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:22 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:22.868482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bda574-9184-4fc5-9e9f-b2155553c4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d8c5eafe7441d5abf4f03e4f21500a, user_id=d08485b78e9d4b7da36c5d35cab574ed, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:22.868570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bda574-9184-4fc5-9e9f-b2155553c4f9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:22.869957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a124401-6f08-4f0e-8fa4-f144f316e3db admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:22.888326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 976/1953] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:22 2022] PUT /identity/v3/projects/06d8c5eafe7441d5abf4f03e4f21500a/users/d08485b78e9d4b7da36c5d35cab574ed/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:22.900058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f23960-ed95-4c14-9608-e5bbbcbf6dd1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:22.900058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f23960-ed95-4c14-9608-e5bbbcbf6dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:22.900058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f23960-ed95-4c14-9608-e5bbbcbf6dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:22.925411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:22.937315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-85f23960-ed95-4c14-9608-e5bbbcbf6dd1 None None] MFA Rules not processed for user `d08485b78e9d4b7da36c5d35cab574ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:22.939530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-85f23960-ed95-4c14-9608-e5bbbcbf6dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:23.001906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a124401-6f08-4f0e-8fa4-f144f316e3db admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:23.035635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 977/1954] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:23.045782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f23960-ed95-4c14-9608-e5bbbcbf6dd1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:23.115230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dd7af-b11a-4f0e-b94e-89ae0c3e83be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:23.115960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dd7af-b11a-4f0e-b94e-89ae0c3e83be admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.116861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dd7af-b11a-4f0e-b94e-89ae0c3e83be admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.117150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dd7af-b11a-4f0e-b94e-89ae0c3e83be admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.118606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dd7af-b11a-4f0e-b94e-89ae0c3e83be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:23.120929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dd7af-b11a-4f0e-b94e-89ae0c3e83be admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:23.123922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f23960-ed95-4c14-9608-e5bbbcbf6dd1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:23.128874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906579-e237-47b3-a067-00da94962fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:23.129736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906579-e237-47b3-a067-00da94962fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.130101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906579-e237-47b3-a067-00da94962fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.130592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906579-e237-47b3-a067-00da94962fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.143270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906579-e237-47b3-a067-00da94962fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:23.144830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906579-e237-47b3-a067-00da94962fb1 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:23.146128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 978/1955] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:22 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:23.146971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dd7af-b11a-4f0e-b94e-89ae0c3e83be admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:23.148576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c29dd7af-b11a-4f0e-b94e-89ae0c3e83be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:23.156084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 978/1956] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:23.156856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906579-e237-47b3-a067-00da94962fb1 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:23.163762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dd7af-b11a-4f0e-b94e-89ae0c3e83be admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:23.167922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746da7a-d1e0-42eb-822d-a9bd8ed52397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:23.168556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746da7a-d1e0-42eb-822d-a9bd8ed52397 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.168841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746da7a-d1e0-42eb-822d-a9bd8ed52397 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.168939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906579-e237-47b3-a067-00da94962fb1 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:23.169108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746da7a-d1e0-42eb-822d-a9bd8ed52397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.174050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b202d-4fd2-4de4-b442-bd825e060875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:23.175005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b202d-4fd2-4de4-b442-bd825e060875 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.175298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b202d-4fd2-4de4-b442-bd825e060875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.176104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b202d-4fd2-4de4-b442-bd825e060875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.176985 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b202d-4fd2-4de4-b442-bd825e060875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:23.183183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b202d-4fd2-4de4-b442-bd825e060875 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:23.194915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:23.212924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 979/1957] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:23.212924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b202d-4fd2-4de4-b442-bd825e060875 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:23.229946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b202d-4fd2-4de4-b442-bd825e060875 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:23.237433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb1ad7-7a68-4539-add1-cf1851badbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:23.238629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb1ad7-7a68-4539-add1-cf1851badbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.238873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb1ad7-7a68-4539-add1-cf1851badbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.239122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb1ad7-7a68-4539-add1-cf1851badbbb admin admin] PATH_INFO: `/v3/projects/5f3103ceaeff4d40baa41e82792f4fb3/users/02c8413c2b60463c96843262a3c9cbda/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.259842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb1ad7-7a68-4539-add1-cf1851badbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3103ceaeff4d40baa41e82792f4fb3, user_id=02c8413c2b60463c96843262a3c9cbda, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:23.263359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb1ad7-7a68-4539-add1-cf1851badbbb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:23.279908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 980/1958] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:23 2022] PUT /identity/v3/projects/5f3103ceaeff4d40baa41e82792f4fb3/users/02c8413c2b60463c96843262a3c9cbda/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:23.283357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb1ad7-7a68-4539-add1-cf1851badbbb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:23.283653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746da7a-d1e0-42eb-822d-a9bd8ed52397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:23.285852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746da7a-d1e0-42eb-822d-a9bd8ed52397 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:23.299066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 979/1959] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:23.299995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746da7a-d1e0-42eb-822d-a9bd8ed52397 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:23.313743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746da7a-d1e0-42eb-822d-a9bd8ed52397 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:23.386947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb1ad7-7a68-4539-add1-cf1851badbbb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:23.400523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a8466-6b2c-4a8c-9244-0cc32d3295c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:23.401197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a8466-6b2c-4a8c-9244-0cc32d3295c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.401550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a8466-6b2c-4a8c-9244-0cc32d3295c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.401974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a8466-6b2c-4a8c-9244-0cc32d3295c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.402632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a8466-6b2c-4a8c-9244-0cc32d3295c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:23.404584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a8466-6b2c-4a8c-9244-0cc32d3295c9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:23.408037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee396254-30d0-48e7-a442-4004b75819b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:23.408676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee396254-30d0-48e7-a442-4004b75819b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.408962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee396254-30d0-48e7-a442-4004b75819b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.409869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee396254-30d0-48e7-a442-4004b75819b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.411776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ee396254-30d0-48e7-a442-4004b75819b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:23.421586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 980/1960] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:23.426022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a8466-6b2c-4a8c-9244-0cc32d3295c9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:23.448798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:23.472702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a8466-6b2c-4a8c-9244-0cc32d3295c9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:23.488088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895c219-db1b-4b2f-9973-c63185aaa72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:23.488907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895c219-db1b-4b2f-9973-c63185aaa72e admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.489199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895c219-db1b-4b2f-9973-c63185aaa72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.489746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895c219-db1b-4b2f-9973-c63185aaa72e admin admin] PATH_INFO: `/v3/projects/5f3103ceaeff4d40baa41e82792f4fb3/users/02c8413c2b60463c96843262a3c9cbda/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.495034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895c219-db1b-4b2f-9973-c63185aaa72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3103ceaeff4d40baa41e82792f4fb3, user_id=02c8413c2b60463c96843262a3c9cbda, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:23.499303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895c219-db1b-4b2f-9973-c63185aaa72e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:23.539043 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 981/1961] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:23 2022] PUT /identity/v3/projects/5f3103ceaeff4d40baa41e82792f4fb3/users/02c8413c2b60463c96843262a3c9cbda/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:23.542964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eafa23-1f8a-4f03-bae7-3fc0212c8aa5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.543256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eafa23-1f8a-4f03-bae7-3fc0212c8aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.543557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eafa23-1f8a-4f03-bae7-3fc0212c8aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.569978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee396254-30d0-48e7-a442-4004b75819b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:23.573824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee396254-30d0-48e7-a442-4004b75819b6 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:23.597675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 981/1962] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:23.626256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-e6eafa23-1f8a-4f03-bae7-3fc0212c8aa5 None None] MFA Rules not processed for user `02c8413c2b60463c96843262a3c9cbda`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:23.627518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e6eafa23-1f8a-4f03-bae7-3fc0212c8aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:23.762586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 982/1963] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:23.777979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee396254-30d0-48e7-a442-4004b75819b6 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:23.803277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee396254-30d0-48e7-a442-4004b75819b6 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:23.867934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccce60-6720-4090-bcc1-7d5a62d7dc70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:23.868564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccce60-6720-4090-bcc1-7d5a62d7dc70 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:23.868846 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccce60-6720-4090-bcc1-7d5a62d7dc70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:23.869121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccce60-6720-4090-bcc1-7d5a62d7dc70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:23.879997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccce60-6720-4090-bcc1-7d5a62d7dc70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:23.881637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccce60-6720-4090-bcc1-7d5a62d7dc70 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:23.891998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 982/1964] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:23.948512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eafa23-1f8a-4f03-bae7-3fc0212c8aa5 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:24.022499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:24.100758 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eafa23-1f8a-4f03-bae7-3fc0212c8aa5 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:24.106781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:24.107871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:24.108092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:24.108205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] PATH_INFO: `/v3/users/aa0e17a3f6ff4145984ce584d8dc0ca9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:24.109577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0e17a3f6ff4145984ce584d8dc0ca9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:24.111798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:24.174358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0e17a3f6ff4145984ce584d8dc0ca9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.187894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0e17a3f6ff4145984ce584d8dc0ca9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.189209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0e17a3f6ff4145984ce584d8dc0ca9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.203861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0e17a3f6ff4145984ce584d8dc0ca9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.223546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0e17a3f6ff4145984ce584d8dc0ca9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.230666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 983/1965] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:23 2022] DELETE /identity/v3/users/aa0e17a3f6ff4145984ce584d8dc0ca9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:24.239110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479c92a-71b7-4aef-8d7b-bd0efe40684f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:24.239820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479c92a-71b7-4aef-8d7b-bd0efe40684f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:24.240574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479c92a-71b7-4aef-8d7b-bd0efe40684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:24.271853 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-5479c92a-71b7-4aef-8d7b-bd0efe40684f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:24.274901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5479c92a-71b7-4aef-8d7b-bd0efe40684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:24.374213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 983/1966] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:24.384606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:24.386270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:24.430185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479c92a-71b7-4aef-8d7b-bd0efe40684f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:24.431637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5479c92a-71b7-4aef-8d7b-bd0efe40684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:24.445851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479c92a-71b7-4aef-8d7b-bd0efe40684f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:24.451264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:24.451910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:24.452192 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:24.452469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] PATH_INFO: `/v3/users/c2d7dcf487214272a87fa8f21d5b4504` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:24.453680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d7dcf487214272a87fa8f21d5b4504)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:24.455608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:24.457692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa2a35-4934-4f2a-b9f4-957e5fac35df admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:24.462687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11ea65-944d-407f-b2b5-5d11ad4184e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:24.462687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11ea65-944d-407f-b2b5-5d11ad4184e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:24.462687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11ea65-944d-407f-b2b5-5d11ad4184e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:24.463155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11ea65-944d-407f-b2b5-5d11ad4184e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:24.474729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11ea65-944d-407f-b2b5-5d11ad4184e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:24.476202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11ea65-944d-407f-b2b5-5d11ad4184e7 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:24.489695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 984/1967] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:24.509587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d7dcf487214272a87fa8f21d5b4504'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.518377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d7dcf487214272a87fa8f21d5b4504'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.519707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d7dcf487214272a87fa8f21d5b4504'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.520874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:24.542337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d7dcf487214272a87fa8f21d5b4504'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.553490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d7dcf487214272a87fa8f21d5b4504'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:24.561714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 984/1968] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:24 2022] DELETE /identity/v3/users/c2d7dcf487214272a87fa8f21d5b4504 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:24.567664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc802cec-44df-4709-b51b-0376bcde3f8a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:24.568234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc802cec-44df-4709-b51b-0376bcde3f8a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:24.571004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc802cec-44df-4709-b51b-0376bcde3f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:24.606618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-dc802cec-44df-4709-b51b-0376bcde3f8a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:24.607884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dc802cec-44df-4709-b51b-0376bcde3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:24.664658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:24.686892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 985/1969] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:24.698461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:24.700580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:24.768437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151240-e309-413b-adb9-69a0d805f150 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:24.773430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9e3c6-e3f0-488a-836b-85d4232f2d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:24.775218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9e3c6-e3f0-488a-836b-85d4232f2d2c service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:24.775678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9e3c6-e3f0-488a-836b-85d4232f2d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:24.776087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9e3c6-e3f0-488a-836b-85d4232f2d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:24.789084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9e3c6-e3f0-488a-836b-85d4232f2d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:24.791094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9e3c6-e3f0-488a-836b-85d4232f2d2c service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:24.804821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 985/1970] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:25.001440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc802cec-44df-4709-b51b-0376bcde3f8a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:25.003692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dc802cec-44df-4709-b51b-0376bcde3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:25.017968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc802cec-44df-4709-b51b-0376bcde3f8a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:25.040500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:25.041187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:25.041515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:25.041870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] PATH_INFO: `/v3/projects/d4bde12101764fde9fba354fe5c41a60` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:25.042937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4bde12101764fde9fba354fe5c41a60)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:25.044917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:25.105034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4bde12101764fde9fba354fe5c41a60', 'request_id': 'req-247980f7-51e2-4ccd-8a0d-30397d41fcd0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.116520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4bde12101764fde9fba354fe5c41a60', 'request_id': 'req-247980f7-51e2-4ccd-8a0d-30397d41fcd0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.149207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4bde12101764fde9fba354fe5c41a60', 'request_id': 'req-247980f7-51e2-4ccd-8a0d-30397d41fcd0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.171649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] The token cache is being invalidate because project d4bde12101764fde9fba354fe5c41a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:25.172129 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.173228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.176676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 986/1971] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:25 2022] DELETE /identity/v3/projects/d4bde12101764fde9fba354fe5c41a60 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:25.180910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9e3c6-e3f0-488a-836b-85d4232f2d2c service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:25.194532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9e3c6-e3f0-488a-836b-85d4232f2d2c service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:25.281181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:25.281989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:25.282379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:25.283314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] PATH_INFO: `/v3/users/7664329ba3544fd38f988bb6b1268bc1` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:25.284846 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7664329ba3544fd38f988bb6b1268bc1)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:25.286971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:25.354705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7664329ba3544fd38f988bb6b1268bc1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.367267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7664329ba3544fd38f988bb6b1268bc1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.367964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7664329ba3544fd38f988bb6b1268bc1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.374625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:25.376401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:25.393609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7664329ba3544fd38f988bb6b1268bc1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.396012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247980f7-51e2-4ccd-8a0d-30397d41fcd0 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:25.400587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:25.402037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:25.402869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:25.403302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:25.405100 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] PATH_INFO: `/v3/projects/8877e0052e134a9faf26cf3136287084` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:25.405373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7664329ba3544fd38f988bb6b1268bc1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.407805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8877e0052e134a9faf26cf3136287084)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:25.413227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:25.418393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 986/1972] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:25 2022] DELETE /identity/v3/users/7664329ba3544fd38f988bb6b1268bc1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:25.495217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8877e0052e134a9faf26cf3136287084', 'request_id': 'req-040d7b37-e56c-435b-8056-198b92284fea'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.503786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8877e0052e134a9faf26cf3136287084', 'request_id': 'req-040d7b37-e56c-435b-8056-198b92284fea'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.510319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8877e0052e134a9faf26cf3136287084', 'request_id': 'req-040d7b37-e56c-435b-8056-198b92284fea'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.524265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] The token cache is being invalidate because project 8877e0052e134a9faf26cf3136287084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:25.524552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.525415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.526968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 987/1973] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:25 2022] DELETE /identity/v3/projects/8877e0052e134a9faf26cf3136287084 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:25.531317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:25.532965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:25.630862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c37cc-d002-499f-bc54-8d37739e28b4 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:25.719243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:25.719918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:25.720203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:25.720484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] PATH_INFO: `/v3/users/02c8413c2b60463c96843262a3c9cbda` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:25.722288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c8413c2b60463c96843262a3c9cbda)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:25.724475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:25.782837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:25.783486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c8413c2b60463c96843262a3c9cbda'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.784964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:25.793379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c8413c2b60463c96843262a3c9cbda'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.793967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c8413c2b60463c96843262a3c9cbda'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.811085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7b37-e56c-435b-8056-198b92284fea admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:25.817511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:25.817797 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c8413c2b60463c96843262a3c9cbda'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.818261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:25.818548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:25.818859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] PATH_INFO: `/v3/projects/7fc5eb3b28d740e186f5e3f20273dada` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:25.820375 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc5eb3b28d740e186f5e3f20273dada)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:25.822910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:25.825737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4238ea7a-e243-4cd3-9d5b-a6b7c4d77ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c8413c2b60463c96843262a3c9cbda'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.832738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 987/1974] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:25 2022] DELETE /identity/v3/users/02c8413c2b60463c96843262a3c9cbda => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:25.902884 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc5eb3b28d740e186f5e3f20273dada', 'request_id': 'req-d2cbb22f-2cdb-40db-bb89-2346165188d5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.905376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:25.916734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc5eb3b28d740e186f5e3f20273dada', 'request_id': 'req-d2cbb22f-2cdb-40db-bb89-2346165188d5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.932595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc5eb3b28d740e186f5e3f20273dada', 'request_id': 'req-d2cbb22f-2cdb-40db-bb89-2346165188d5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.960551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] The token cache is being invalidate because project 7fc5eb3b28d740e186f5e3f20273dada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:25.960852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.961668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d2cbb22f-2cdb-40db-bb89-2346165188d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:25.968424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 988/1975] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:25 2022] DELETE /identity/v3/projects/7fc5eb3b28d740e186f5e3f20273dada => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:25.970550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51971c-01ad-49a0-8699-e93e5200bcca None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:25.970953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51971c-01ad-49a0-8699-e93e5200bcca None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:25.971301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51971c-01ad-49a0-8699-e93e5200bcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.001351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2e51971c-01ad-49a0-8699-e93e5200bcca None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:26.004215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2e51971c-01ad-49a0-8699-e93e5200bcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:26.024020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:26.131187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 988/1976] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:26.140487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfac6a-01e9-467d-86ec-49107f320b22 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:26.141048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfac6a-01e9-467d-86ec-49107f320b22 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:26.141225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfac6a-01e9-467d-86ec-49107f320b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.170066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-60dfac6a-01e9-467d-86ec-49107f320b22 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:26.171996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-60dfac6a-01e9-467d-86ec-49107f320b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:26.189254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51971c-01ad-49a0-8699-e93e5200bcca None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:26.195704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 989/1977] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:26.207179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51971c-01ad-49a0-8699-e93e5200bcca None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:26.214260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe6b0b-1eb1-477f-98e6-a4592279b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:26.215153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe6b0b-1eb1-477f-98e6-a4592279b272 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:26.215657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe6b0b-1eb1-477f-98e6-a4592279b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:26.215940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe6b0b-1eb1-477f-98e6-a4592279b272 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.216984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe6b0b-1eb1-477f-98e6-a4592279b272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:26.217432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe6b0b-1eb1-477f-98e6-a4592279b272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:26.219684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe6b0b-1eb1-477f-98e6-a4592279b272 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:26.238070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 989/1978] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:26.244581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfac6a-01e9-467d-86ec-49107f320b22 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:26.255440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfac6a-01e9-467d-86ec-49107f320b22 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:26.261924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180787f-7387-4a8a-91be-ab2643b80d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:26.262581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180787f-7387-4a8a-91be-ab2643b80d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:26.262781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180787f-7387-4a8a-91be-ab2643b80d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:26.263025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180787f-7387-4a8a-91be-ab2643b80d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.263834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180787f-7387-4a8a-91be-ab2643b80d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:26.266544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180787f-7387-4a8a-91be-ab2643b80d05 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:26.307361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 990/1979] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:26 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:26.312780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe6b0b-1eb1-477f-98e6-a4592279b272 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:26.326752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe6b0b-1eb1-477f-98e6-a4592279b272 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:26.459156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d10130-19a2-452f-89bb-ec6675f03aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:26.460183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d10130-19a2-452f-89bb-ec6675f03aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:26.460720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d10130-19a2-452f-89bb-ec6675f03aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:26.461139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d10130-19a2-452f-89bb-ec6675f03aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.461971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d10130-19a2-452f-89bb-ec6675f03aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:26.464233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d10130-19a2-452f-89bb-ec6675f03aa8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:26.496464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 990/1980] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:26 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:26.501398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180787f-7387-4a8a-91be-ab2643b80d05 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:26.516071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180787f-7387-4a8a-91be-ab2643b80d05 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:26.524609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f6e47-e05b-4a75-81e2-d82662b051a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:26.525847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f6e47-e05b-4a75-81e2-d82662b051a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:26.526306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f6e47-e05b-4a75-81e2-d82662b051a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:26.526771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f6e47-e05b-4a75-81e2-d82662b051a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.527691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f6e47-e05b-4a75-81e2-d82662b051a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:26.529872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f6e47-e05b-4a75-81e2-d82662b051a1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:26.545324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 991/1981] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:26.552097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d10130-19a2-452f-89bb-ec6675f03aa8 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:26.565808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d10130-19a2-452f-89bb-ec6675f03aa8 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:26.573147 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1e626-5bd3-4b05-a803-9b0aa474fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:26.575676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e626-5bd3-4b05-a803-9b0aa474fbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:26.575676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e626-5bd3-4b05-a803-9b0aa474fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:26.575676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e626-5bd3-4b05-a803-9b0aa474fbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.576356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1e626-5bd3-4b05-a803-9b0aa474fbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:26.578397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1e626-5bd3-4b05-a803-9b0aa474fbf5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:26.598032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 991/1982] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:26.600251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f6e47-e05b-4a75-81e2-d82662b051a1 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:26.612836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f6e47-e05b-4a75-81e2-d82662b051a1 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:26.618211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef3ed8-535c-40a7-bca1-a58c45a6c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:26.619339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef3ed8-535c-40a7-bca1-a58c45a6c038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:26.619864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef3ed8-535c-40a7-bca1-a58c45a6c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:26.620213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef3ed8-535c-40a7-bca1-a58c45a6c038 admin admin] PATH_INFO: `/v3/projects/548952ee417047e89acb05a84b03cdb0/users/93c906c81f2249dea0c1766840e62a5a/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.640322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef3ed8-535c-40a7-bca1-a58c45a6c038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548952ee417047e89acb05a84b03cdb0, user_id=93c906c81f2249dea0c1766840e62a5a, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:26.643107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef3ed8-535c-40a7-bca1-a58c45a6c038 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:26.669584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 992/1983] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:26 2022] PUT /identity/v3/projects/548952ee417047e89acb05a84b03cdb0/users/93c906c81f2249dea0c1766840e62a5a/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:26.681689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53d8e-a1de-4192-b0f3-b6872e2664b1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:26.682213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53d8e-a1de-4192-b0f3-b6872e2664b1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:26.682699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53d8e-a1de-4192-b0f3-b6872e2664b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.719276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-25f53d8e-a1de-4192-b0f3-b6872e2664b1 None None] MFA Rules not processed for user `93c906c81f2249dea0c1766840e62a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:26.720636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-25f53d8e-a1de-4192-b0f3-b6872e2664b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:26.815992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef3ed8-535c-40a7-bca1-a58c45a6c038 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:26.817920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-29ef3ed8-535c-40a7-bca1-a58c45a6c038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:26.870830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 992/1984] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:26.876444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f53d8e-a1de-4192-b0f3-b6872e2664b1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:26.896143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:26.902323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef3ed8-535c-40a7-bca1-a58c45a6c038 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:26.908367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:26.909035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:26.909682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:26.909973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] PATH_INFO: `/v3/projects/5f3103ceaeff4d40baa41e82792f4fb3` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:26.911254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3103ceaeff4d40baa41e82792f4fb3)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:26.913200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:26.955109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f53d8e-a1de-4192-b0f3-b6872e2664b1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:26.968493 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3103ceaeff4d40baa41e82792f4fb3', 'request_id': 'req-ced959ca-65a6-471f-8f29-6fd9d6ae2137'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:26.979507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3103ceaeff4d40baa41e82792f4fb3', 'request_id': 'req-ced959ca-65a6-471f-8f29-6fd9d6ae2137'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:26.989599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3103ceaeff4d40baa41e82792f4fb3', 'request_id': 'req-ced959ca-65a6-471f-8f29-6fd9d6ae2137'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:27.008254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] The token cache is being invalidate because project 5f3103ceaeff4d40baa41e82792f4fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:27.008568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:27.009756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:27.011675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 993/1985] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:26 2022] DELETE /identity/v3/projects/5f3103ceaeff4d40baa41e82792f4fb3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:27.012338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.013691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:27.022127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:27.033755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e75c2-20f9-4e1f-bfe3-7ff1fa7248bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.034672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e75c2-20f9-4e1f-bfe3-7ff1fa7248bc admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.034672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e75c2-20f9-4e1f-bfe3-7ff1fa7248bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.034958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e75c2-20f9-4e1f-bfe3-7ff1fa7248bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.035652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e75c2-20f9-4e1f-bfe3-7ff1fa7248bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.038144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e75c2-20f9-4e1f-bfe3-7ff1fa7248bc admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.071300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 993/1986] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:26 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:27.077020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0aeb4-b0bd-4d20-ad3f-073f5d2d23e9 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.077430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0aeb4-b0bd-4d20-ad3f-073f5d2d23e9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.077817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0aeb4-b0bd-4d20-ad3f-073f5d2d23e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.103915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e0f0aeb4-b0bd-4d20-ad3f-073f5d2d23e9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:27.105776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced959ca-65a6-471f-8f29-6fd9d6ae2137 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.109295 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e0f0aeb4-b0bd-4d20-ad3f-073f5d2d23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:27.173217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.173907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.174193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.174473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] PATH_INFO: `/v3/users/a2effa79a8364da0a7e5c5d0266e4bb1` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.175663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2effa79a8364da0a7e5c5d0266e4bb1)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.177624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.180636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 994/1987] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:27.181571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0aeb4-b0bd-4d20-ad3f-073f5d2d23e9 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.183018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e0f0aeb4-b0bd-4d20-ad3f-073f5d2d23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:27.196963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0aeb4-b0bd-4d20-ad3f-073f5d2d23e9 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.207301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546bcda-6024-4636-9410-1dd4e97c8915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.207920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546bcda-6024-4636-9410-1dd4e97c8915 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.208201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546bcda-6024-4636-9410-1dd4e97c8915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.208466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546bcda-6024-4636-9410-1dd4e97c8915 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.209097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546bcda-6024-4636-9410-1dd4e97c8915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.211053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546bcda-6024-4636-9410-1dd4e97c8915 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.243205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 995/1988] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:27 2022] POST /identity/v3/users => generated 299 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:27.243205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126df8a-a372-47b3-b045-863a28a0d4d6 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.243205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126df8a-a372-47b3-b045-863a28a0d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.243205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126df8a-a372-47b3-b045-863a28a0d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.248258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2effa79a8364da0a7e5c5d0266e4bb1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:27.258768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2effa79a8364da0a7e5c5d0266e4bb1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:27.259386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2effa79a8364da0a7e5c5d0266e4bb1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:27.264862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-c126df8a-a372-47b3-b045-863a28a0d4d6 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:27.266748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c126df8a-a372-47b3-b045-863a28a0d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:27.273448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2effa79a8364da0a7e5c5d0266e4bb1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:27.279396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 996/1989] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:27.280263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126df8a-a372-47b3-b045-863a28a0d4d6 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.281654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c126df8a-a372-47b3-b045-863a28a0d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:27.284898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2effa79a8364da0a7e5c5d0266e4bb1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:27.291911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 994/1990] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:27 2022] DELETE /identity/v3/users/a2effa79a8364da0a7e5c5d0266e4bb1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:27.292841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.300179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126df8a-a372-47b3-b045-863a28a0d4d6 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.322217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:27.329102 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:27.364275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f4647-acac-498a-b8ad-ae29ff3297b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.364505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee10b1-0152-4235-b982-f1ca18d32b6c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.365024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f4647-acac-498a-b8ad-ae29ff3297b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.365394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f4647-acac-498a-b8ad-ae29ff3297b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.365615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f4647-acac-498a-b8ad-ae29ff3297b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.366264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f4647-acac-498a-b8ad-ae29ff3297b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.367921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f4647-acac-498a-b8ad-ae29ff3297b0 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.369477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fea50-bb57-46e2-a100-8e5112aa3c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.370228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fea50-bb57-46e2-a100-8e5112aa3c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.370899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fea50-bb57-46e2-a100-8e5112aa3c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.371061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fea50-bb57-46e2-a100-8e5112aa3c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.371590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fea50-bb57-46e2-a100-8e5112aa3c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:27.371966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fea50-bb57-46e2-a100-8e5112aa3c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.373639 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fea50-bb57-46e2-a100-8e5112aa3c4c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.379648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 997/1991] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:27.380909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613a848-b248-402e-9deb-202f979491b7 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.381195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613a848-b248-402e-9deb-202f979491b7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.381496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613a848-b248-402e-9deb-202f979491b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.389413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 995/1992] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:27.390532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fea50-bb57-46e2-a100-8e5112aa3c4c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.403281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fea50-bb57-46e2-a100-8e5112aa3c4c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.406472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-b613a848-b248-402e-9deb-202f979491b7 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:27.407890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b613a848-b248-402e-9deb-202f979491b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:27.410178 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4536e67-f259-4c84-af10-01eaee0f1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.410940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4536e67-f259-4c84-af10-01eaee0f1cff admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.411294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4536e67-f259-4c84-af10-01eaee0f1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.411642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4536e67-f259-4c84-af10-01eaee0f1cff admin admin] PATH_INFO: `/v3/projects/cf7571849828424782295e10ae4ee63c/users/4e9926f9731346429dab07f467448977/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.432303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 998/1993] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:27.432303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613a848-b248-402e-9deb-202f979491b7 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.436643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4536e67-f259-4c84-af10-01eaee0f1cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7571849828424782295e10ae4ee63c, user_id=4e9926f9731346429dab07f467448977, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.439739 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4536e67-f259-4c84-af10-01eaee0f1cff admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.445625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613a848-b248-402e-9deb-202f979491b7 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.451917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb5e52-1610-4176-85fa-1c3a5ebdb8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.453012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb5e52-1610-4176-85fa-1c3a5ebdb8fd admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.453369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb5e52-1610-4176-85fa-1c3a5ebdb8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.453650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb5e52-1610-4176-85fa-1c3a5ebdb8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.454281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb5e52-1610-4176-85fa-1c3a5ebdb8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.456444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb5e52-1610-4176-85fa-1c3a5ebdb8fd admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.458229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 996/1994] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:27 2022] PUT /identity/v3/projects/cf7571849828424782295e10ae4ee63c/users/4e9926f9731346429dab07f467448977/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:27.459724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4536e67-f259-4c84-af10-01eaee0f1cff admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.462031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a4536e67-f259-4c84-af10-01eaee0f1cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:27.491050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 999/1995] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:27 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:27.491252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb5e52-1610-4176-85fa-1c3a5ebdb8fd admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.553658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4536e67-f259-4c84-af10-01eaee0f1cff admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.589435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb5e52-1610-4176-85fa-1c3a5ebdb8fd admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.605126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e54ad-e584-40ed-a62c-47f9271f1984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.605793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e54ad-e584-40ed-a62c-47f9271f1984 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.606078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e54ad-e584-40ed-a62c-47f9271f1984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.606347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e54ad-e584-40ed-a62c-47f9271f1984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.607006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e54ad-e584-40ed-a62c-47f9271f1984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.612574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e54ad-e584-40ed-a62c-47f9271f1984 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.617490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b946b-cb48-4f7b-b82f-30223d9fe852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.618298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b946b-cb48-4f7b-b82f-30223d9fe852 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.618740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b946b-cb48-4f7b-b82f-30223d9fe852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.619263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b946b-cb48-4f7b-b82f-30223d9fe852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.635894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b946b-cb48-4f7b-b82f-30223d9fe852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.642992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b946b-cb48-4f7b-b82f-30223d9fe852 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.647069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1000/1996] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:27.649100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e54ad-e584-40ed-a62c-47f9271f1984 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.670744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e54ad-e584-40ed-a62c-47f9271f1984 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.677747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fda39-37e0-455d-80d1-b01613a3e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.678783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fda39-37e0-455d-80d1-b01613a3e922 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.679218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fda39-37e0-455d-80d1-b01613a3e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.679642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fda39-37e0-455d-80d1-b01613a3e922 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.680632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03fda39-37e0-455d-80d1-b01613a3e922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.682798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03fda39-37e0-455d-80d1-b01613a3e922 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.707186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 997/1997] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:27.708234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b946b-cb48-4f7b-b82f-30223d9fe852 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.721154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b946b-cb48-4f7b-b82f-30223d9fe852 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.743335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dba23-0b21-4ad4-9a4b-bc438e593907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.744021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dba23-0b21-4ad4-9a4b-bc438e593907 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.744305 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dba23-0b21-4ad4-9a4b-bc438e593907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.744589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dba23-0b21-4ad4-9a4b-bc438e593907 admin admin] PATH_INFO: `/v3/projects/cf7571849828424782295e10ae4ee63c/users/4e9926f9731346429dab07f467448977/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.759603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1001/1998] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:27 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:27.764229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dba23-0b21-4ad4-9a4b-bc438e593907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7571849828424782295e10ae4ee63c, user_id=4e9926f9731346429dab07f467448977, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.765500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fda39-37e0-455d-80d1-b01613a3e922 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.769892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dba23-0b21-4ad4-9a4b-bc438e593907 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.778989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fda39-37e0-455d-80d1-b01613a3e922 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.785662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f19f9-3a17-440c-abe0-68ff25efb122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.786305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f19f9-3a17-440c-abe0-68ff25efb122 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.786589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f19f9-3a17-440c-abe0-68ff25efb122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.787206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f19f9-3a17-440c-abe0-68ff25efb122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.788300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f19f9-3a17-440c-abe0-68ff25efb122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.790889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f19f9-3a17-440c-abe0-68ff25efb122 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.804746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 998/1999] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:27 2022] PUT /identity/v3/projects/cf7571849828424782295e10ae4ee63c/users/4e9926f9731346429dab07f467448977/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:27.806665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea485-ddf5-417d-bcd2-63c10aaeae4c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.807035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea485-ddf5-417d-bcd2-63c10aaeae4c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.807332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea485-ddf5-417d-bcd2-63c10aaeae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.812303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1002/2000] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:27.813536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f19f9-3a17-440c-abe0-68ff25efb122 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.829038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f19f9-3a17-440c-abe0-68ff25efb122 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.843672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-9c3ea485-ddf5-417d-bcd2-63c10aaeae4c None None] MFA Rules not processed for user `4e9926f9731346429dab07f467448977`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:27.845051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9c3ea485-ddf5-417d-bcd2-63c10aaeae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:27.911127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:27.953291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5dca5-62bb-4ee9-8799-23f783130ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.954227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5dca5-62bb-4ee9-8799-23f783130ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.954393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5dca5-62bb-4ee9-8799-23f783130ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.954600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5dca5-62bb-4ee9-8799-23f783130ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:27.955299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5dca5-62bb-4ee9-8799-23f783130ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:27.957891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5dca5-62bb-4ee9-8799-23f783130ee5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:27.959976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:27.969858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 999/2001] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:27.976205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea485-ddf5-417d-bcd2-63c10aaeae4c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.981950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1003/2002] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:27.984000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5dca5-62bb-4ee9-8799-23f783130ee5 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:27.986057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-eab5dca5-62bb-4ee9-8799-23f783130ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:27.988998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea485-ddf5-417d-bcd2-63c10aaeae4c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:27.994458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa69a8-f776-446c-9f73-8d5c07e83ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:27.995295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa69a8-f776-446c-9f73-8d5c07e83ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:27.995832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa69a8-f776-446c-9f73-8d5c07e83ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:27.996262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa69a8-f776-446c-9f73-8d5c07e83ad8 admin admin] PATH_INFO: `/v3/projects/318bce85ff1440b49e18e849a069893a/users/102e8da3cedf478db88a1ba57bc4805d/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.014105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa69a8-f776-446c-9f73-8d5c07e83ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318bce85ff1440b49e18e849a069893a, user_id=102e8da3cedf478db88a1ba57bc4805d, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:28.017119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa69a8-f776-446c-9f73-8d5c07e83ad8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:28.033483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1000/2003] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:27 2022] PUT /identity/v3/projects/318bce85ff1440b49e18e849a069893a/users/102e8da3cedf478db88a1ba57bc4805d/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:28.046074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ec588-d0b1-4e84-b059-560c092fef51 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:28.046292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ec588-d0b1-4e84-b059-560c092fef51 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:28.046603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ec588-d0b1-4e84-b059-560c092fef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.074030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5dca5-62bb-4ee9-8799-23f783130ee5 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:28.091722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-df3ec588-d0b1-4e84-b059-560c092fef51 None None] MFA Rules not processed for user `102e8da3cedf478db88a1ba57bc4805d`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:28.093923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-df3ec588-d0b1-4e84-b059-560c092fef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:28.166340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b7750-915e-493f-b8fe-f8c26fb3b142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:28.166598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b7750-915e-493f-b8fe-f8c26fb3b142 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:28.167252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b7750-915e-493f-b8fe-f8c26fb3b142 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:28.167783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b7750-915e-493f-b8fe-f8c26fb3b142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.171796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5f0b7750-915e-493f-b8fe-f8c26fb3b142 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:28.177388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1001/2004] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:28.180283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ec588-d0b1-4e84-b059-560c092fef51 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:28.258435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ec588-d0b1-4e84-b059-560c092fef51 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:28.264158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854857c-6c1b-48ec-ae91-c3c414805d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:28.264795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854857c-6c1b-48ec-ae91-c3c414805d65 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:28.265125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854857c-6c1b-48ec-ae91-c3c414805d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:28.265566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854857c-6c1b-48ec-ae91-c3c414805d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.266226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854857c-6c1b-48ec-ae91-c3c414805d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:28.268516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854857c-6c1b-48ec-ae91-c3c414805d65 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:28.271447 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b7750-915e-493f-b8fe-f8c26fb3b142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:28.273069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b7750-915e-493f-b8fe-f8c26fb3b142 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:28.284467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1004/2005] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:28.309849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1002/2006] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:28 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:28.313742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b7750-915e-493f-b8fe-f8c26fb3b142 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:28.329895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b7750-915e-493f-b8fe-f8c26fb3b142 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:28.414896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854857c-6c1b-48ec-ae91-c3c414805d65 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:28.416788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8854857c-6c1b-48ec-ae91-c3c414805d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:28.417913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc3c45-a08c-402c-8142-b31da0a9d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:28.418616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc3c45-a08c-402c-8142-b31da0a9d1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:28.418914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc3c45-a08c-402c-8142-b31da0a9d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:28.419170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc3c45-a08c-402c-8142-b31da0a9d1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.420061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc3c45-a08c-402c-8142-b31da0a9d1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:28.422199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc3c45-a08c-402c-8142-b31da0a9d1b0 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:28.436993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:28.437204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854857c-6c1b-48ec-ae91-c3c414805d65 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:28.458660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:28.459338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:28.459614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:28.459887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] PATH_INFO: `/v3/projects/a952dea9ed2b4126a294e987c670741d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.461220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a952dea9ed2b4126a294e987c670741d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:28.463255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:28.466538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1005/2007] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:28 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:28.482930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc3c45-a08c-402c-8142-b31da0a9d1b0 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:28.495130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc3c45-a08c-402c-8142-b31da0a9d1b0 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:28.501516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:28.502886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a57eb-90b6-493b-a7df-5a64a1b034d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:28.503392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a57eb-90b6-493b-a7df-5a64a1b034d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:28.504041 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a57eb-90b6-493b-a7df-5a64a1b034d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:28.504758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a57eb-90b6-493b-a7df-5a64a1b034d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.505482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a57eb-90b6-493b-a7df-5a64a1b034d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:28.507356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a57eb-90b6-493b-a7df-5a64a1b034d9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:28.530927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1006/2008] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:28.537700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a57eb-90b6-493b-a7df-5a64a1b034d9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:28.557898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a57eb-90b6-493b-a7df-5a64a1b034d9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:28.580548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a952dea9ed2b4126a294e987c670741d', 'request_id': 'req-e2608eb8-1d3c-4b81-9976-7487a6046c21'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:28.598775 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a952dea9ed2b4126a294e987c670741d', 'request_id': 'req-e2608eb8-1d3c-4b81-9976-7487a6046c21'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:28.618108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a952dea9ed2b4126a294e987c670741d', 'request_id': 'req-e2608eb8-1d3c-4b81-9976-7487a6046c21'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:28.645076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] The token cache is being invalidate because project a952dea9ed2b4126a294e987c670741d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:28.645516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:28.648885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:28.652484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1003/2009] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:28 2022] DELETE /identity/v3/projects/a952dea9ed2b4126a294e987c670741d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:28.656290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467f56b-3b81-43f6-a48d-069e39c0c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:28.656407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:28.657143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467f56b-3b81-43f6-a48d-069e39c0c52a admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:28.657554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467f56b-3b81-43f6-a48d-069e39c0c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:28.657941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467f56b-3b81-43f6-a48d-069e39c0c52a admin admin] PATH_INFO: `/v3/projects/08f0c4d5b8194f7b929c24fe5fd6e4d4/users/3700928fac664df984dad3db154163f6/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.665680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:28.685467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467f56b-3b81-43f6-a48d-069e39c0c52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f0c4d5b8194f7b929c24fe5fd6e4d4, user_id=3700928fac664df984dad3db154163f6, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:28.689359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467f56b-3b81-43f6-a48d-069e39c0c52a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:28.703700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608eb8-1d3c-4b81-9976-7487a6046c21 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:28.714366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1007/2010] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:28 2022] PUT /identity/v3/projects/08f0c4d5b8194f7b929c24fe5fd6e4d4/users/3700928fac664df984dad3db154163f6/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:28.716039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467f56b-3b81-43f6-a48d-069e39c0c52a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:28.722387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b467f56b-3b81-43f6-a48d-069e39c0c52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:28.844243 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:28.845044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:28.845371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:28.845654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] PATH_INFO: `/v3/users/a9539d0018594f9abbecc11c8a47415a` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.846915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9539d0018594f9abbecc11c8a47415a)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:28.849025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:28.939916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467f56b-3b81-43f6-a48d-069e39c0c52a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:28.944457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9539d0018594f9abbecc11c8a47415a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:28.953481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd97f43-91c6-4764-bf83-c2966a8b58c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:28.954564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd97f43-91c6-4764-bf83-c2966a8b58c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:28.955072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd97f43-91c6-4764-bf83-c2966a8b58c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:28.955438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9539d0018594f9abbecc11c8a47415a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:28.955764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd97f43-91c6-4764-bf83-c2966a8b58c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:28.956590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9539d0018594f9abbecc11c8a47415a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:28.957073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd97f43-91c6-4764-bf83-c2966a8b58c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:28.959224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd97f43-91c6-4764-bf83-c2966a8b58c9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:28.972010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1008/2011] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:28.976408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd97f43-91c6-4764-bf83-c2966a8b58c9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:28.978719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9539d0018594f9abbecc11c8a47415a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:28.980423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5bd97f43-91c6-4764-bf83-c2966a8b58c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:29.004853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0fcd6edf-1c48-4b29-b7d4-35fa2ec3ac4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9539d0018594f9abbecc11c8a47415a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.012315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd97f43-91c6-4764-bf83-c2966a8b58c9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:29.015497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1004/2012] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:28 2022] DELETE /identity/v3/users/a9539d0018594f9abbecc11c8a47415a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:29.018055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2fe76-ee85-4832-9d8f-248b2d64f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:29.018942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2fe76-ee85-4832-9d8f-248b2d64f92e admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:29.019643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2fe76-ee85-4832-9d8f-248b2d64f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:29.019643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2fe76-ee85-4832-9d8f-248b2d64f92e admin admin] PATH_INFO: `/v3/projects/08f0c4d5b8194f7b929c24fe5fd6e4d4/users/3700928fac664df984dad3db154163f6/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:29.021806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2fe76-ee85-4832-9d8f-248b2d64f92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f0c4d5b8194f7b929c24fe5fd6e4d4, user_id=3700928fac664df984dad3db154163f6, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:29.024671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2fe76-ee85-4832-9d8f-248b2d64f92e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:29.045653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1009/2013] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:28 2022] PUT /identity/v3/projects/08f0c4d5b8194f7b929c24fe5fd6e4d4/users/3700928fac664df984dad3db154163f6/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:29.057752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e763a31-59f6-49d4-b94f-ce80eaeca42d None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:29.058592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e763a31-59f6-49d4-b94f-ce80eaeca42d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:29.058592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e763a31-59f6-49d4-b94f-ce80eaeca42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:29.098197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4e763a31-59f6-49d4-b94f-ce80eaeca42d None None] MFA Rules not processed for user `3700928fac664df984dad3db154163f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:29.099796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4e763a31-59f6-49d4-b94f-ce80eaeca42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:29.119698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:29.211765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1005/2014] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:29.227079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2fe76-ee85-4832-9d8f-248b2d64f92e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:29.229491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-bac2fe76-ee85-4832-9d8f-248b2d64f92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:29.305922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2fe76-ee85-4832-9d8f-248b2d64f92e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:29.326695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028181d-1b41-419d-9009-290fe05b05a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:29.327585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028181d-1b41-419d-9009-290fe05b05a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:29.328018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028181d-1b41-419d-9009-290fe05b05a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:29.329225 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028181d-1b41-419d-9009-290fe05b05a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:29.334771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c028181d-1b41-419d-9009-290fe05b05a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:29.348982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:29.411218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e763a31-59f6-49d4-b94f-ce80eaeca42d None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:29.411969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4e763a31-59f6-49d4-b94f-ce80eaeca42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:29.447362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028181d-1b41-419d-9009-290fe05b05a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:29.449061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028181d-1b41-419d-9009-290fe05b05a2 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:29.461820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1010/2015] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:29.523721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e763a31-59f6-49d4-b94f-ce80eaeca42d None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:29.529705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:29.530423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:29.530700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:29.530979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] PATH_INFO: `/v3/projects/0205400e8b5540bf855dba6b4fcc85e4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:29.532761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0205400e8b5540bf855dba6b4fcc85e4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:29.534937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:29.615141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0205400e8b5540bf855dba6b4fcc85e4', 'request_id': 'req-465085a0-d47f-4e15-aa3a-e2be9d917363'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.624858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0205400e8b5540bf855dba6b4fcc85e4', 'request_id': 'req-465085a0-d47f-4e15-aa3a-e2be9d917363'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.633302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0205400e8b5540bf855dba6b4fcc85e4', 'request_id': 'req-465085a0-d47f-4e15-aa3a-e2be9d917363'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.649206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] The token cache is being invalidate because project 0205400e8b5540bf855dba6b4fcc85e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:29.649701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.650596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.652658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1006/2016] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:29 2022] DELETE /identity/v3/projects/0205400e8b5540bf855dba6b4fcc85e4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:29.658830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028181d-1b41-419d-9009-290fe05b05a2 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:29.683765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028181d-1b41-419d-9009-290fe05b05a2 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:29.775235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:29.776143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:29.776559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:29.776991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] PATH_INFO: `/v3/users/d08485b78e9d4b7da36c5d35cab574ed` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:29.778270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08485b78e9d4b7da36c5d35cab574ed)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:29.780558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:29.902628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08485b78e9d4b7da36c5d35cab574ed'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.913393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08485b78e9d4b7da36c5d35cab574ed'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.913832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08485b78e9d4b7da36c5d35cab574ed'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.930862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08485b78e9d4b7da36c5d35cab574ed'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.940892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-34182e82-71d9-480c-97c0-2a4e0abdbe49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08485b78e9d4b7da36c5d35cab574ed'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:29.953395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1011/2017] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:29 2022] DELETE /identity/v3/users/d08485b78e9d4b7da36c5d35cab574ed => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:30.504715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:30.518198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:30.552138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465085a0-d47f-4e15-aa3a-e2be9d917363 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:30.660742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:30.718502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:30.720891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:30.721190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:30.724327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] PATH_INFO: `/v3/projects/06d8c5eafe7441d5abf4f03e4f21500a` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:30.728874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d8c5eafe7441d5abf4f03e4f21500a)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:30.735838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:30.886249 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d8c5eafe7441d5abf4f03e4f21500a', 'request_id': 'req-b515f7be-6024-4273-87fb-19f359827d80'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:30.905729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d8c5eafe7441d5abf4f03e4f21500a', 'request_id': 'req-b515f7be-6024-4273-87fb-19f359827d80'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:30.920181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d8c5eafe7441d5abf4f03e4f21500a', 'request_id': 'req-b515f7be-6024-4273-87fb-19f359827d80'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:30.935071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] The token cache is being invalidate because project 06d8c5eafe7441d5abf4f03e4f21500a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:30.935694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:30.936670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:30.939107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1007/2018] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:30 2022] DELETE /identity/v3/projects/06d8c5eafe7441d5abf4f03e4f21500a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:30.945670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90f23a-404f-48d7-bc9f-30138605147f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:30.946720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90f23a-404f-48d7-bc9f-30138605147f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:30.947041 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90f23a-404f-48d7-bc9f-30138605147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:30.970030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3a90f23a-404f-48d7-bc9f-30138605147f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:30.971940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3a90f23a-404f-48d7-bc9f-30138605147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:31.005612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:31.007071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:31.012286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:31.075657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1012/2019] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:31.077056 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3b31e-0c3a-4fa0-a067-e8592fcda5ec None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:31.077379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3b31e-0c3a-4fa0-a067-e8592fcda5ec None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:31.077657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3b31e-0c3a-4fa0-a067-e8592fcda5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:31.100822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515f7be-6024-4273-87fb-19f359827d80 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:31.100822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89efd12-929d-4fc1-8e3f-c3f73ecf09fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:31.100822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89efd12-929d-4fc1-8e3f-c3f73ecf09fd service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:31.100822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89efd12-929d-4fc1-8e3f-c3f73ecf09fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:31.101172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89efd12-929d-4fc1-8e3f-c3f73ecf09fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:31.101172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b89efd12-929d-4fc1-8e3f-c3f73ecf09fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:31.125298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1ef3b31e-0c3a-4fa0-a067-e8592fcda5ec None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:31.126555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1ef3b31e-0c3a-4fa0-a067-e8592fcda5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:31.141693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1013/2020] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:31.145678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3b31e-0c3a-4fa0-a067-e8592fcda5ec None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:31.160112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3b31e-0c3a-4fa0-a067-e8592fcda5ec None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:31.168131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5a192-7299-4195-b0e7-4b154fd13cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:31.168976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5a192-7299-4195-b0e7-4b154fd13cee admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:31.169092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5a192-7299-4195-b0e7-4b154fd13cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:31.169335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5a192-7299-4195-b0e7-4b154fd13cee admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:31.170157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5a192-7299-4195-b0e7-4b154fd13cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:31.170465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5a192-7299-4195-b0e7-4b154fd13cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:31.172287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5a192-7299-4195-b0e7-4b154fd13cee admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:31.192118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1014/2021] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:31.203020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89efd12-929d-4fc1-8e3f-c3f73ecf09fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:31.206294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89efd12-929d-4fc1-8e3f-c3f73ecf09fd service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:31.207676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5a192-7299-4195-b0e7-4b154fd13cee admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:31.223826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5a192-7299-4195-b0e7-4b154fd13cee admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:31.230997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1008/2022] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:31.232335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca687-4f2e-4970-bb60-a4a7bc0d4eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:31.233083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca687-4f2e-4970-bb60-a4a7bc0d4eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:31.233479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca687-4f2e-4970-bb60-a4a7bc0d4eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:31.233811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca687-4f2e-4970-bb60-a4a7bc0d4eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:31.234935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ca687-4f2e-4970-bb60-a4a7bc0d4eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:31.238428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ca687-4f2e-4970-bb60-a4a7bc0d4eb9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:31.281546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1015/2023] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:31 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:31.286452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89efd12-929d-4fc1-8e3f-c3f73ecf09fd service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:31.304572 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89efd12-929d-4fc1-8e3f-c3f73ecf09fd service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:31.335374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:31.435991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b75db-0026-4f32-ac14-2327e0a60f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:31.436886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b75db-0026-4f32-ac14-2327e0a60f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:31.437351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b75db-0026-4f32-ac14-2327e0a60f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:31.437680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b75db-0026-4f32-ac14-2327e0a60f18 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:31.439095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b75db-0026-4f32-ac14-2327e0a60f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:31.443127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b75db-0026-4f32-ac14-2327e0a60f18 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:31.507970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1009/2024] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:31 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:31.509396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca687-4f2e-4970-bb60-a4a7bc0d4eb9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:31.521596 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca687-4f2e-4970-bb60-a4a7bc0d4eb9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:31.528298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af2ecf-e360-4920-81e1-50a68fd4b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:31.529123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af2ecf-e360-4920-81e1-50a68fd4b72a admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:31.529583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af2ecf-e360-4920-81e1-50a68fd4b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:31.530010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af2ecf-e360-4920-81e1-50a68fd4b72a admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:31.531453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af2ecf-e360-4920-81e1-50a68fd4b72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:31.533408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af2ecf-e360-4920-81e1-50a68fd4b72a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:31.556277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1016/2025] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:26:31.559082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b75db-0026-4f32-ac14-2327e0a60f18 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:31.576942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b75db-0026-4f32-ac14-2327e0a60f18 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:31.587440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ab93d-1c9d-4a6b-8bfa-a609dc391839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:31.589335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ab93d-1c9d-4a6b-8bfa-a609dc391839 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:31.589931 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ab93d-1c9d-4a6b-8bfa-a609dc391839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:31.591292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ab93d-1c9d-4a6b-8bfa-a609dc391839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:31.593144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ab93d-1c9d-4a6b-8bfa-a609dc391839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:31.595707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ab93d-1c9d-4a6b-8bfa-a609dc391839 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:31.615896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1010/2026] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:31.621509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af2ecf-e360-4920-81e1-50a68fd4b72a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:31.643571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af2ecf-e360-4920-81e1-50a68fd4b72a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:31.656034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfcd1f-2c01-44f8-a9d2-d8cab8a60fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:31.656793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfcd1f-2c01-44f8-a9d2-d8cab8a60fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:31.657079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfcd1f-2c01-44f8-a9d2-d8cab8a60fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:31.657409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfcd1f-2c01-44f8-a9d2-d8cab8a60fb1 admin admin] PATH_INFO: `/v3/projects/53b3d9f3905d4556b7ac1849ee7a5656/users/d63e743bfd6542d6a7fc139ec7262ef8/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:31.700258 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfcd1f-2c01-44f8-a9d2-d8cab8a60fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b3d9f3905d4556b7ac1849ee7a5656, user_id=d63e743bfd6542d6a7fc139ec7262ef8, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:31.707970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfcd1f-2c01-44f8-a9d2-d8cab8a60fb1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:31.745996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1017/2027] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:31 2022] PUT /identity/v3/projects/53b3d9f3905d4556b7ac1849ee7a5656/users/d63e743bfd6542d6a7fc139ec7262ef8/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:31.747441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acefa0-e314-40c8-aa47-6bc0b997efdf None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:31.747734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acefa0-e314-40c8-aa47-6bc0b997efdf None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:31.748230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acefa0-e314-40c8-aa47-6bc0b997efdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:31.831952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d2acefa0-e314-40c8-aa47-6bc0b997efdf None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:31.834311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d2acefa0-e314-40c8-aa47-6bc0b997efdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:31.968315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfcd1f-2c01-44f8-a9d2-d8cab8a60fb1 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:31.972147 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a3dfcd1f-2c01-44f8-a9d2-d8cab8a60fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:31.993706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1011/2028] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:32.007131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acefa0-e314-40c8-aa47-6bc0b997efdf None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:32.009711 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d2acefa0-e314-40c8-aa47-6bc0b997efdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:32.115174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfcd1f-2c01-44f8-a9d2-d8cab8a60fb1 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:32.121568 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:32.122466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:32.122816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:32.123262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] PATH_INFO: `/v3/users/82b7945788e7492da0f23a043d9fded8` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:32.125350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b7945788e7492da0f23a043d9fded8)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:32.127448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:32.147767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acefa0-e314-40c8-aa47-6bc0b997efdf None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:32.154094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457a409-cfa4-4e4f-bb63-3448de2844f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:32.155041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a409-cfa4-4e4f-bb63-3448de2844f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:32.155612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a409-cfa4-4e4f-bb63-3448de2844f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:32.156068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a409-cfa4-4e4f-bb63-3448de2844f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:32.174927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457a409-cfa4-4e4f-bb63-3448de2844f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:32.177593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457a409-cfa4-4e4f-bb63-3448de2844f3 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:32.197640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1012/2029] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:32.245478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b7945788e7492da0f23a043d9fded8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:32.249145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:32.262059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b7945788e7492da0f23a043d9fded8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:32.263479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b7945788e7492da0f23a043d9fded8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:32.283315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b7945788e7492da0f23a043d9fded8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:32.294460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b7945788e7492da0f23a043d9fded8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:32.305317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1018/2030] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:31 2022] DELETE /identity/v3/users/82b7945788e7492da0f23a043d9fded8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:32.312466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9133fb-f363-475f-bdff-1dfa647701fa None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:32.312804 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9133fb-f363-475f-bdff-1dfa647701fa None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:32.313088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9133fb-f363-475f-bdff-1dfa647701fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:32.345083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-dc9133fb-f363-475f-bdff-1dfa647701fa None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:32.348120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dc9133fb-f363-475f-bdff-1dfa647701fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:32.420725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:32.479059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1013/2031] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:32.511378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:32.518026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:32.686393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2addfe-8fd6-4bd0-a9d5-cdcb749fe3b2 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:32.700533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6a853-9f04-4ec6-9328-7a77e8477de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:32.701185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6a853-9f04-4ec6-9328-7a77e8477de0 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:32.701590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6a853-9f04-4ec6-9328-7a77e8477de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:32.701791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6a853-9f04-4ec6-9328-7a77e8477de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:32.732357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6a853-9f04-4ec6-9328-7a77e8477de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:32.733887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6a853-9f04-4ec6-9328-7a77e8477de0 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:32.760968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1019/2032] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:33.369335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1489d-3bd2-42bb-ba24-1e3b96877e85 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:33.369930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1489d-3bd2-42bb-ba24-1e3b96877e85 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:33.369930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1489d-3bd2-42bb-ba24-1e3b96877e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:33.407402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c8e1489d-3bd2-42bb-ba24-1e3b96877e85 None None] MFA Rules not processed for user `d63e743bfd6542d6a7fc139ec7262ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:33.409159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c8e1489d-3bd2-42bb-ba24-1e3b96877e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:33.508579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1014/2033] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:33.513007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6a853-9f04-4ec6-9328-7a77e8477de0 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:33.514564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9bb6a853-9f04-4ec6-9328-7a77e8477de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:33.529884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6a853-9f04-4ec6-9328-7a77e8477de0 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:33.536839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c796e5e-1f43-4167-b962-9a3ec7f88775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:33.537672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c796e5e-1f43-4167-b962-9a3ec7f88775 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:33.538043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c796e5e-1f43-4167-b962-9a3ec7f88775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:33.538410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c796e5e-1f43-4167-b962-9a3ec7f88775 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:33.539195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c796e5e-1f43-4167-b962-9a3ec7f88775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:33.541269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c796e5e-1f43-4167-b962-9a3ec7f88775 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:33.583475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1489d-3bd2-42bb-ba24-1e3b96877e85 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:33.584194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1020/2034] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:33 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:33.598929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1489d-3bd2-42bb-ba24-1e3b96877e85 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:33.695348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7db64f-a831-4ece-9618-e5d6e2a0a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:33.696528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7db64f-a831-4ece-9618-e5d6e2a0a09a admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:33.696979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7db64f-a831-4ece-9618-e5d6e2a0a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:33.697943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7db64f-a831-4ece-9618-e5d6e2a0a09a admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:33.698916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7db64f-a831-4ece-9618-e5d6e2a0a09a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:33.702398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7db64f-a831-4ece-9618-e5d6e2a0a09a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:33.752650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1015/2035] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:33 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:33.757121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c796e5e-1f43-4167-b962-9a3ec7f88775 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:33.776438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7db64f-a831-4ece-9618-e5d6e2a0a09a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:33.783246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c796e5e-1f43-4167-b962-9a3ec7f88775 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:33.785561 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bf7db64f-a831-4ece-9618-e5d6e2a0a09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:33.790873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2102d-c847-4360-abc9-f2f684640919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:33.791688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2102d-c847-4360-abc9-f2f684640919 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:33.792104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2102d-c847-4360-abc9-f2f684640919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:33.792483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2102d-c847-4360-abc9-f2f684640919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:33.793530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2102d-c847-4360-abc9-f2f684640919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:33.797615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2102d-c847-4360-abc9-f2f684640919 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:33.845457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1021/2036] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:33.850493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2102d-c847-4360-abc9-f2f684640919 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:33.882603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2102d-c847-4360-abc9-f2f684640919 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:33.892496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ce64a-c2b9-4534-94cd-7aad43f66ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:33.893655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ce64a-c2b9-4534-94cd-7aad43f66ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:33.894404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ce64a-c2b9-4534-94cd-7aad43f66ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:33.894688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ce64a-c2b9-4534-94cd-7aad43f66ed0 admin admin] PATH_INFO: `/v3/projects/2171273aeef54bf997ec84be9d59098a/users/79fb6c239248469dad196b331ba77cf6/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:33.969358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ce64a-c2b9-4534-94cd-7aad43f66ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2171273aeef54bf997ec84be9d59098a, user_id=79fb6c239248469dad196b331ba77cf6, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:33.974101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ce64a-c2b9-4534-94cd-7aad43f66ed0 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:33.977189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7db64f-a831-4ece-9618-e5d6e2a0a09a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:33.992587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:33.994298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:33.994668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:33.995234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:33.997825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:34.010460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1022/2037] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:33 2022] PUT /identity/v3/projects/2171273aeef54bf997ec84be9d59098a/users/79fb6c239248469dad196b331ba77cf6/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:34.018014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:34.027410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ce64a-c2b9-4534-94cd-7aad43f66ed0 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:34.146812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:34.148267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:34.163501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1016/2038] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:34.164221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:34.165683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:34.181554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeff031-910b-4c51-9927-de8daff13dbf service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:34.182469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ce64a-c2b9-4534-94cd-7aad43f66ed0 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:34.190291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:34.191126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:34.191204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:34.191487 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] PATH_INFO: `/v3/projects/b90dc8d77a4448b084b7e8df35e8ca39` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:34.192641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90dc8d77a4448b084b7e8df35e8ca39)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:34.193939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3022e-f276-4932-9974-6ac4ad918d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:34.194576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3022e-f276-4932-9974-6ac4ad918d55 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:34.194835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:34.194940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3022e-f276-4932-9974-6ac4ad918d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:34.195126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3022e-f276-4932-9974-6ac4ad918d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:34.195837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3022e-f276-4932-9974-6ac4ad918d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:34.204244 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3022e-f276-4932-9974-6ac4ad918d55 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:34.232734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1023/2039] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:34.235091 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3022e-f276-4932-9974-6ac4ad918d55 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:34.261377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90dc8d77a4448b084b7e8df35e8ca39', 'request_id': 'req-ebc44d1c-303d-4405-815e-77ed5b94ac56'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:34.273029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90dc8d77a4448b084b7e8df35e8ca39', 'request_id': 'req-ebc44d1c-303d-4405-815e-77ed5b94ac56'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:34.280339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3022e-f276-4932-9974-6ac4ad918d55 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:34.296896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90dc8d77a4448b084b7e8df35e8ca39', 'request_id': 'req-ebc44d1c-303d-4405-815e-77ed5b94ac56'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:34.300238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:34.320923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] The token cache is being invalidate because project b90dc8d77a4448b084b7e8df35e8ca39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:34.322121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:34.323412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ebc44d1c-303d-4405-815e-77ed5b94ac56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:34.326329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1017/2040] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:34 2022] DELETE /identity/v3/projects/b90dc8d77a4448b084b7e8df35e8ca39 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:34.332625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586b95-fe99-46e6-aedc-079dcd52a6b5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:34.333274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586b95-fe99-46e6-aedc-079dcd52a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:34.333741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586b95-fe99-46e6-aedc-079dcd52a6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:34.383123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-ef586b95-fe99-46e6-aedc-079dcd52a6b5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:34.386017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ef586b95-fe99-46e6-aedc-079dcd52a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:34.482715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901457ce-ca84-4de7-84a6-536828898e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:34.483598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901457ce-ca84-4de7-84a6-536828898e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:34.484044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901457ce-ca84-4de7-84a6-536828898e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:34.484466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901457ce-ca84-4de7-84a6-536828898e1f admin admin] PATH_INFO: `/v3/projects/2171273aeef54bf997ec84be9d59098a/users/79fb6c239248469dad196b331ba77cf6/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:34.486742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901457ce-ca84-4de7-84a6-536828898e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2171273aeef54bf997ec84be9d59098a, user_id=79fb6c239248469dad196b331ba77cf6, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:34.489705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901457ce-ca84-4de7-84a6-536828898e1f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:34.530393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1024/2041] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:34 2022] PUT /identity/v3/projects/2171273aeef54bf997ec84be9d59098a/users/79fb6c239248469dad196b331ba77cf6/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:34.558103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1018/2042] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:34.579164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd52cf-cb0d-40a0-a3c4-c523f4df2fb2 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:34.580068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd52cf-cb0d-40a0-a3c4-c523f4df2fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:34.580603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd52cf-cb0d-40a0-a3c4-c523f4df2fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:34.628411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-f0bd52cf-cb0d-40a0-a3c4-c523f4df2fb2 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:34.633138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f0bd52cf-cb0d-40a0-a3c4-c523f4df2fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:34.758150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1025/2043] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:34.764223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586b95-fe99-46e6-aedc-079dcd52a6b5 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:34.790602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586b95-fe99-46e6-aedc-079dcd52a6b5 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:34.823426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07970250-18f0-4f07-b994-af66898796e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:34.823426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07970250-18f0-4f07-b994-af66898796e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:34.823426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07970250-18f0-4f07-b994-af66898796e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:34.823426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07970250-18f0-4f07-b994-af66898796e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:34.824085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07970250-18f0-4f07-b994-af66898796e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:34.824085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07970250-18f0-4f07-b994-af66898796e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:34.824085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07970250-18f0-4f07-b994-af66898796e8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:34.852374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1019/2044] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:34.854891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd52cf-cb0d-40a0-a3c4-c523f4df2fb2 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:34.867903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd52cf-cb0d-40a0-a3c4-c523f4df2fb2 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:34.883287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1816-86bc-4858-92fd-eeb15a55466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:34.883287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1816-86bc-4858-92fd-eeb15a55466e admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:34.883287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1816-86bc-4858-92fd-eeb15a55466e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:34.883287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1816-86bc-4858-92fd-eeb15a55466e admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:34.883831 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1816-86bc-4858-92fd-eeb15a55466e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:34.888092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1816-86bc-4858-92fd-eeb15a55466e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:34.954894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1026/2045] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:34 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:34.961890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07970250-18f0-4f07-b994-af66898796e8 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:34.978293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07970250-18f0-4f07-b994-af66898796e8 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:35.047530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:35.132790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe8bc8-bac7-4fe6-989b-23d2bcf2a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:35.133583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe8bc8-bac7-4fe6-989b-23d2bcf2a5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:35.133971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe8bc8-bac7-4fe6-989b-23d2bcf2a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:35.134633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe8bc8-bac7-4fe6-989b-23d2bcf2a5b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:35.135661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe8bc8-bac7-4fe6-989b-23d2bcf2a5b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:35.137747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe8bc8-bac7-4fe6-989b-23d2bcf2a5b4 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:35.192164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1020/2046] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:34 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:35.193870 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1816-86bc-4858-92fd-eeb15a55466e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:35.230551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1816-86bc-4858-92fd-eeb15a55466e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:35.236770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5898-fd8d-46f0-a782-b456e78373da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:35.237532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5898-fd8d-46f0-a782-b456e78373da admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:35.237822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5898-fd8d-46f0-a782-b456e78373da admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:35.238104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5898-fd8d-46f0-a782-b456e78373da admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:35.238759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d5898-fd8d-46f0-a782-b456e78373da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:35.240526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d5898-fd8d-46f0-a782-b456e78373da admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:35.253882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1027/2047] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:35.257968 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe8bc8-bac7-4fe6-989b-23d2bcf2a5b4 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:35.269230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe8bc8-bac7-4fe6-989b-23d2bcf2a5b4 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:35.274312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03678d-1b58-4fe9-b496-75b99fa50903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:35.275123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03678d-1b58-4fe9-b496-75b99fa50903 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:35.275418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03678d-1b58-4fe9-b496-75b99fa50903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:35.275851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03678d-1b58-4fe9-b496-75b99fa50903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:35.276519 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03678d-1b58-4fe9-b496-75b99fa50903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:35.278189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03678d-1b58-4fe9-b496-75b99fa50903 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:35.293299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1021/2048] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:35.297904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5898-fd8d-46f0-a782-b456e78373da admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:35.312053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5898-fd8d-46f0-a782-b456e78373da admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:35.320151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b35dd-e4cf-4905-816b-062169627e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:35.320843 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b35dd-e4cf-4905-816b-062169627e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:35.321121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b35dd-e4cf-4905-816b-062169627e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:35.321443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b35dd-e4cf-4905-816b-062169627e59 admin admin] PATH_INFO: `/v3/projects/8b5a07e26d8a48d99d50a9f71e963297/users/9ab2e106e0fa4becaaac29caf3b69176/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:35.351050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b35dd-e4cf-4905-816b-062169627e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5a07e26d8a48d99d50a9f71e963297, user_id=9ab2e106e0fa4becaaac29caf3b69176, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:35.358693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b35dd-e4cf-4905-816b-062169627e59 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:35.405803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1028/2049] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:35 2022] PUT /identity/v3/projects/8b5a07e26d8a48d99d50a9f71e963297/users/9ab2e106e0fa4becaaac29caf3b69176/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:35.418013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c046b4-f045-43e6-a57e-d745f0c2d706 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:35.418746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c046b4-f045-43e6-a57e-d745f0c2d706 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:35.418746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c046b4-f045-43e6-a57e-d745f0c2d706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:35.473336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-79c046b4-f045-43e6-a57e-d745f0c2d706 None None] MFA Rules not processed for user `9ab2e106e0fa4becaaac29caf3b69176`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:35.475057 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-79c046b4-f045-43e6-a57e-d745f0c2d706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:35.600233 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1022/2050] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:35.615960 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b35dd-e4cf-4905-816b-062169627e59 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:35.620264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9d0b35dd-e4cf-4905-816b-062169627e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:35.750696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:35.759162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b35dd-e4cf-4905-816b-062169627e59 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:35.768171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc8910-20c3-4d26-9724-0d328c95f83c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab45d09f8724d9ca5b6fb1fa050fdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:35.768987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc8910-20c3-4d26-9724-0d328c95f83c service glance] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:35.769702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc8910-20c3-4d26-9724-0d328c95f83c service glance] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:35.769702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc8910-20c3-4d26-9724-0d328c95f83c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:35.789786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc8910-20c3-4d26-9724-0d328c95f83c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:35.791452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc8910-20c3-4d26-9724-0d328c95f83c service glance] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:35.806286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1029/2051] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:36.063852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c19f-e29b-422b-85e1-5e88ad2f7240 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:36.064067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c19f-e29b-422b-85e1-5e88ad2f7240 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:36.064348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c19f-e29b-422b-85e1-5e88ad2f7240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:36.134014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-35d2c19f-e29b-422b-85e1-5e88ad2f7240 None None] MFA Rules not processed for user `79fb6c239248469dad196b331ba77cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:36.144635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-35d2c19f-e29b-422b-85e1-5e88ad2f7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:36.313466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f53ad5-b004-4c67-a12e-531086625f08 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:36.313827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f53ad5-b004-4c67-a12e-531086625f08 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:36.314168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f53ad5-b004-4c67-a12e-531086625f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:36.317746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1023/2052] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:36.349570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-56f53ad5-b004-4c67-a12e-531086625f08 None None] MFA Rules not processed for user `d63e743bfd6542d6a7fc139ec7262ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:36.354181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-56f53ad5-b004-4c67-a12e-531086625f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:36.448991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1030/2053] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:36.463483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2c19f-e29b-422b-85e1-5e88ad2f7240 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:36.465059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-35d2c19f-e29b-422b-85e1-5e88ad2f7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:36.493826 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:36.586076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2c19f-e29b-422b-85e1-5e88ad2f7240 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:36.634873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea3b48-4a2d-451f-ac7f-b4b1ae9b4632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:36.635629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea3b48-4a2d-451f-ac7f-b4b1ae9b4632 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:36.636016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea3b48-4a2d-451f-ac7f-b4b1ae9b4632 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:36.636338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea3b48-4a2d-451f-ac7f-b4b1ae9b4632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:36.641645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9aea3b48-4a2d-451f-ac7f-b4b1ae9b4632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:36.653291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f53ad5-b004-4c67-a12e-531086625f08 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:36.654761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-56f53ad5-b004-4c67-a12e-531086625f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:36.667089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea3b48-4a2d-451f-ac7f-b4b1ae9b4632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:36.684077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea3b48-4a2d-451f-ac7f-b4b1ae9b4632 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:36.726659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1024/2054] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:36.790652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f53ad5-b004-4c67-a12e-531086625f08 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:36.808893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:36.811075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:36.811546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:36.812837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] PATH_INFO: `/v3/users/102e8da3cedf478db88a1ba57bc4805d` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:36.817124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] RBAC: Authorizing `identity:delete_user(user_id=102e8da3cedf478db88a1ba57bc4805d)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:36.821769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:36.935491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102e8da3cedf478db88a1ba57bc4805d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:36.949136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102e8da3cedf478db88a1ba57bc4805d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:36.949907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102e8da3cedf478db88a1ba57bc4805d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:36.966540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102e8da3cedf478db88a1ba57bc4805d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:36.975253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102e8da3cedf478db88a1ba57bc4805d'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:36.985284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1031/2055] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:36 2022] DELETE /identity/v3/users/102e8da3cedf478db88a1ba57bc4805d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:36.989276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d179a-3040-4c22-8341-2eeedd17d278 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:36.989276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d179a-3040-4c22-8341-2eeedd17d278 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:36.989604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d179a-3040-4c22-8341-2eeedd17d278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:37.016770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6e6d179a-3040-4c22-8341-2eeedd17d278 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:37.018002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6e6d179a-3040-4c22-8341-2eeedd17d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:37.116072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1025/2056] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:37.127420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:37.130336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:37.146710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:37.229934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bef53-2d5e-4a57-9a8b-4f9c797e261e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:37.235534 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918d3e2-d09d-4638-b1c0-540f7fe17c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:37.236238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918d3e2-d09d-4638-b1c0-540f7fe17c0a service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:37.236811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918d3e2-d09d-4638-b1c0-540f7fe17c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:37.237060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918d3e2-d09d-4638-b1c0-540f7fe17c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:37.251912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918d3e2-d09d-4638-b1c0-540f7fe17c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:37.254169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918d3e2-d09d-4638-b1c0-540f7fe17c0a service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:37.265562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1032/2057] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:37.668651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d179a-3040-4c22-8341-2eeedd17d278 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:37.670980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6e6d179a-3040-4c22-8341-2eeedd17d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:37.688199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d179a-3040-4c22-8341-2eeedd17d278 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:37.696239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:37.698130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:37.699148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:37.699591 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] PATH_INFO: `/v3/projects/318bce85ff1440b49e18e849a069893a` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:37.701915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318bce85ff1440b49e18e849a069893a)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:37.705066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:37.780279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318bce85ff1440b49e18e849a069893a', 'request_id': 'req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:37.789460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318bce85ff1440b49e18e849a069893a', 'request_id': 'req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:37.796526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318bce85ff1440b49e18e849a069893a', 'request_id': 'req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:37.812419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] The token cache is being invalidate because project 318bce85ff1440b49e18e849a069893a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:37.813053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:37.817523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:37.819556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1026/2058] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:37 2022] DELETE /identity/v3/projects/318bce85ff1440b49e18e849a069893a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:37.828257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918d3e2-d09d-4638-b1c0-540f7fe17c0a service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:37.841602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918d3e2-d09d-4638-b1c0-540f7fe17c0a service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:37.922459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:37.923281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:37.923561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:37.923998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] PATH_INFO: `/v3/users/3700928fac664df984dad3db154163f6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:37.925759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3700928fac664df984dad3db154163f6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:37.927979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:38.004283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3700928fac664df984dad3db154163f6'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.014399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3700928fac664df984dad3db154163f6'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.015409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3700928fac664df984dad3db154163f6'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.032352 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3700928fac664df984dad3db154163f6'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.042021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-121882ad-02cc-41db-bad8-2213dfd134d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3700928fac664df984dad3db154163f6'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.051355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1033/2059] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:37 2022] DELETE /identity/v3/users/3700928fac664df984dad3db154163f6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:38.415336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:38.417533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:38.432754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25df6-f316-4c7f-8ec6-1085a5bc75c4 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:38.461162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:38.505485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:38.506303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:38.506673 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:38.506982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] PATH_INFO: `/v3/projects/08f0c4d5b8194f7b929c24fe5fd6e4d4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:38.508192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f0c4d5b8194f7b929c24fe5fd6e4d4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:38.510182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:38.582552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f0c4d5b8194f7b929c24fe5fd6e4d4', 'request_id': 'req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.590632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f0c4d5b8194f7b929c24fe5fd6e4d4', 'request_id': 'req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.597211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f0c4d5b8194f7b929c24fe5fd6e4d4', 'request_id': 'req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.609491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] The token cache is being invalidate because project 08f0c4d5b8194f7b929c24fe5fd6e4d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:38.609786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.610446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3d9f0d7d-ac45-4b8e-ad63-ed35c16761a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:38.611941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1027/2060] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:38 2022] DELETE /identity/v3/projects/08f0c4d5b8194f7b929c24fe5fd6e4d4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:38.617349 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26159a3-435c-431d-b2f6-3765146f18a0 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:38.617646 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26159a3-435c-431d-b2f6-3765146f18a0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:38.617951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26159a3-435c-431d-b2f6-3765146f18a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:38.639934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d26159a3-435c-431d-b2f6-3765146f18a0 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:38.641161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d26159a3-435c-431d-b2f6-3765146f18a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:38.684164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:38.739681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1034/2061] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:38.747596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189d581-33e0-4436-bb54-c593d35ba40a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:38.748155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189d581-33e0-4436-bb54-c593d35ba40a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:38.748155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189d581-33e0-4436-bb54-c593d35ba40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:38.768688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-e189d581-33e0-4436-bb54-c593d35ba40a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:38.769950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e189d581-33e0-4436-bb54-c593d35ba40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:38.778133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1028/2062] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:38.782680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26159a3-435c-431d-b2f6-3765146f18a0 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:38.792961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26159a3-435c-431d-b2f6-3765146f18a0 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:38.799190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9f678-e511-470c-9a98-2412bf319259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:38.800327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9f678-e511-470c-9a98-2412bf319259 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:38.800608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9f678-e511-470c-9a98-2412bf319259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:38.800879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9f678-e511-470c-9a98-2412bf319259 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:38.801576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9f678-e511-470c-9a98-2412bf319259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:38.801878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9f678-e511-470c-9a98-2412bf319259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:38.803486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9f678-e511-470c-9a98-2412bf319259 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:38.816083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1035/2063] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:26:38.821666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189d581-33e0-4436-bb54-c593d35ba40a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:38.832174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189d581-33e0-4436-bb54-c593d35ba40a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:38.837638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c2642-cde4-48ef-9f37-f9ebbfb56cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:38.838383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c2642-cde4-48ef-9f37-f9ebbfb56cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:38.838755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c2642-cde4-48ef-9f37-f9ebbfb56cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:38.839036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c2642-cde4-48ef-9f37-f9ebbfb56cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:38.839754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c2642-cde4-48ef-9f37-f9ebbfb56cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:38.842211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c2642-cde4-48ef-9f37-f9ebbfb56cf2 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:38.888189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1029/2064] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:38 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:38.890019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9f678-e511-470c-9a98-2412bf319259 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:38.904803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9f678-e511-470c-9a98-2412bf319259 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:38.999137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0fa9e-e1a0-40ab-b9aa-19926eb6bb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.000238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0fa9e-e1a0-40ab-b9aa-19926eb6bb69 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.000938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0fa9e-e1a0-40ab-b9aa-19926eb6bb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.001455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0fa9e-e1a0-40ab-b9aa-19926eb6bb69 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.002282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0fa9e-e1a0-40ab-b9aa-19926eb6bb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:39.006526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0fa9e-e1a0-40ab-b9aa-19926eb6bb69 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:39.039841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1036/2065] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:38 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:39.042699 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c2642-cde4-48ef-9f37-f9ebbfb56cf2 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:39.056422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c2642-cde4-48ef-9f37-f9ebbfb56cf2 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:39.065971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88168879-ae3b-423d-a360-13a38691d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.066669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168879-ae3b-423d-a360-13a38691d3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.066959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168879-ae3b-423d-a360-13a38691d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.067240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168879-ae3b-423d-a360-13a38691d3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.067902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88168879-ae3b-423d-a360-13a38691d3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:39.069828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88168879-ae3b-423d-a360-13a38691d3b9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:39.089144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1030/2066] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:39.090567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0fa9e-e1a0-40ab-b9aa-19926eb6bb69 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:39.105482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0fa9e-e1a0-40ab-b9aa-19926eb6bb69 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:39.112856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a984edc-908b-4206-8f35-405f69a245d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.113041 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984edc-908b-4206-8f35-405f69a245d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.113379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984edc-908b-4206-8f35-405f69a245d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.113722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984edc-908b-4206-8f35-405f69a245d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.114647 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a984edc-908b-4206-8f35-405f69a245d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:39.116350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a984edc-908b-4206-8f35-405f69a245d7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:39.132229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1037/2067] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:39.133675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88168879-ae3b-423d-a360-13a38691d3b9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:39.149050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88168879-ae3b-423d-a360-13a38691d3b9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:39.162315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8463-46f7-4658-a756-3006ecc43084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.195187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8463-46f7-4658-a756-3006ecc43084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.195805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8463-46f7-4658-a756-3006ecc43084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.196283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8463-46f7-4658-a756-3006ecc43084 admin admin] PATH_INFO: `/v3/projects/de3fb80660ef4d6a9cf97487082c7dc4/users/0eea94599a3649b78e30a199273d8e3e/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.218108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee8463-46f7-4658-a756-3006ecc43084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3fb80660ef4d6a9cf97487082c7dc4, user_id=0eea94599a3649b78e30a199273d8e3e, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:39.222486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee8463-46f7-4658-a756-3006ecc43084 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:39.238229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1031/2068] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:39 2022] PUT /identity/v3/projects/de3fb80660ef4d6a9cf97487082c7dc4/users/0eea94599a3649b78e30a199273d8e3e/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:39.256185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac04b6f-011a-41d8-afad-fc75cc1a2b53 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.256675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac04b6f-011a-41d8-afad-fc75cc1a2b53 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.257136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac04b6f-011a-41d8-afad-fc75cc1a2b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.296772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-7ac04b6f-011a-41d8-afad-fc75cc1a2b53 None None] MFA Rules not processed for user `0eea94599a3649b78e30a199273d8e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:39.298386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7ac04b6f-011a-41d8-afad-fc75cc1a2b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:39.374783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1038/2069] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:39.380045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8463-46f7-4658-a756-3006ecc43084 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:39.439957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:39.461784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8463-46f7-4658-a756-3006ecc43084 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:39.467604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70aad-4ea0-46f8-91eb-26a8cef6fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.468350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70aad-4ea0-46f8-91eb-26a8cef6fd02 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.468627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70aad-4ea0-46f8-91eb-26a8cef6fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.468942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70aad-4ea0-46f8-91eb-26a8cef6fd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.469709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70aad-4ea0-46f8-91eb-26a8cef6fd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:39.472542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70aad-4ea0-46f8-91eb-26a8cef6fd02 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:39.504513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1032/2070] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:39 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:39.509006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac04b6f-011a-41d8-afad-fc75cc1a2b53 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:39.530247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac04b6f-011a-41d8-afad-fc75cc1a2b53 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:39.561661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:39.599686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce3603-e3f7-4223-bcdb-35cbbc9072b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.599686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce3603-e3f7-4223-bcdb-35cbbc9072b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.599686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce3603-e3f7-4223-bcdb-35cbbc9072b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.600053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce3603-e3f7-4223-bcdb-35cbbc9072b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.600580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce3603-e3f7-4223-bcdb-35cbbc9072b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:39.602548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce3603-e3f7-4223-bcdb-35cbbc9072b6 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:39.627067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1039/2071] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:39 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:39.632513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70aad-4ea0-46f8-91eb-26a8cef6fd02 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:39.646220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70aad-4ea0-46f8-91eb-26a8cef6fd02 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:39.651153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809049d-0c2a-4038-ab85-f5d309362ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.651779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809049d-0c2a-4038-ab85-f5d309362ade admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.652063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809049d-0c2a-4038-ab85-f5d309362ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.652339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809049d-0c2a-4038-ab85-f5d309362ade admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.652990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809049d-0c2a-4038-ab85-f5d309362ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:39.654707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809049d-0c2a-4038-ab85-f5d309362ade admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:39.686878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1033/2072] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:39.693051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce3603-e3f7-4223-bcdb-35cbbc9072b6 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:39.704394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce3603-e3f7-4223-bcdb-35cbbc9072b6 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:39.710781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015dfd44-b6d2-492a-a932-4f5f1becbbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.711418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dfd44-b6d2-492a-a932-4f5f1becbbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.711697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dfd44-b6d2-492a-a932-4f5f1becbbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.711971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dfd44-b6d2-492a-a932-4f5f1becbbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.712626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015dfd44-b6d2-492a-a932-4f5f1becbbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:39.714277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015dfd44-b6d2-492a-a932-4f5f1becbbe3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:39.735076 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1040/2073] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:39.739447 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809049d-0c2a-4038-ab85-f5d309362ade admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:39.767151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809049d-0c2a-4038-ab85-f5d309362ade admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:39.776584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b35ad-b04d-4ee8-ab3c-4f0911d9e5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.777331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b35ad-b04d-4ee8-ab3c-4f0911d9e5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.780554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b35ad-b04d-4ee8-ab3c-4f0911d9e5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.780554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b35ad-b04d-4ee8-ab3c-4f0911d9e5fe admin admin] PATH_INFO: `/v3/projects/4174f17697324cbcbb0dd5d980f9fded/users/624dbfc5433b493c86bfefaec7a01b90/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.794901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b35ad-b04d-4ee8-ab3c-4f0911d9e5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4174f17697324cbcbb0dd5d980f9fded, user_id=624dbfc5433b493c86bfefaec7a01b90, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:39.797472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b35ad-b04d-4ee8-ab3c-4f0911d9e5fe admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:39.820522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1034/2074] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:39 2022] PUT /identity/v3/projects/4174f17697324cbcbb0dd5d980f9fded/users/624dbfc5433b493c86bfefaec7a01b90/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:39.822427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63d1bc-ee2c-4b40-8b46-900f82944789 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.822619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63d1bc-ee2c-4b40-8b46-900f82944789 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.822897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63d1bc-ee2c-4b40-8b46-900f82944789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.853139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-fd63d1bc-ee2c-4b40-8b46-900f82944789 None None] MFA Rules not processed for user `624dbfc5433b493c86bfefaec7a01b90`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:39.854627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fd63d1bc-ee2c-4b40-8b46-900f82944789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:39.925216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1041/2075] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:39.929667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b35ad-b04d-4ee8-ab3c-4f0911d9e5fe admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:39.992440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b35ad-b04d-4ee8-ab3c-4f0911d9e5fe admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:39.996953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a489-b146-46e5-b7ee-a42a83491c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:39.997587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a489-b146-46e5-b7ee-a42a83491c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:39.997869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a489-b146-46e5-b7ee-a42a83491c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:39.998143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a489-b146-46e5-b7ee-a42a83491c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:39.998779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a489-b146-46e5-b7ee-a42a83491c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:40.000665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a489-b146-46e5-b7ee-a42a83491c5a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:40.031548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1035/2076] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:39 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:40.038704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63d1bc-ee2c-4b40-8b46-900f82944789 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:40.053978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63d1bc-ee2c-4b40-8b46-900f82944789 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:40.118627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becf930-4136-481e-8a44-53382ca4c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:40.119244 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becf930-4136-481e-8a44-53382ca4c10a admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.119526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becf930-4136-481e-8a44-53382ca4c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.119800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becf930-4136-481e-8a44-53382ca4c10a admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.120432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becf930-4136-481e-8a44-53382ca4c10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:40.122350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becf930-4136-481e-8a44-53382ca4c10a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:40.150629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1042/2077] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:40 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:40.155201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a489-b146-46e5-b7ee-a42a83491c5a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:40.166085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a489-b146-46e5-b7ee-a42a83491c5a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:40.171936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15c82a-e5da-4d84-9c27-7840090fe263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:40.172818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15c82a-e5da-4d84-9c27-7840090fe263 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.173106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15c82a-e5da-4d84-9c27-7840090fe263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.173442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15c82a-e5da-4d84-9c27-7840090fe263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.174084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15c82a-e5da-4d84-9c27-7840090fe263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:40.176173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15c82a-e5da-4d84-9c27-7840090fe263 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:40.187492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1036/2078] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:40.192409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becf930-4136-481e-8a44-53382ca4c10a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:40.203166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becf930-4136-481e-8a44-53382ca4c10a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:40.208022 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95161d31-7f72-4faa-acd0-7d173c854162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:40.208689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95161d31-7f72-4faa-acd0-7d173c854162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.208972 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95161d31-7f72-4faa-acd0-7d173c854162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.209279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95161d31-7f72-4faa-acd0-7d173c854162 admin admin] PATH_INFO: `/v3/projects/10bc6d6eddcb485680a1411b0bc05631/users/fd71aec9dd8a4f7cb4a6f51508e4d992/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.225492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95161d31-7f72-4faa-acd0-7d173c854162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bc6d6eddcb485680a1411b0bc05631, user_id=fd71aec9dd8a4f7cb4a6f51508e4d992, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:40.228503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95161d31-7f72-4faa-acd0-7d173c854162 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:40.243710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1043/2079] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:40 2022] PUT /identity/v3/projects/10bc6d6eddcb485680a1411b0bc05631/users/fd71aec9dd8a4f7cb4a6f51508e4d992/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:40.247790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15c82a-e5da-4d84-9c27-7840090fe263 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:40.259090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15c82a-e5da-4d84-9c27-7840090fe263 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:40.328562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4edd0-df88-4ee8-9ad4-3d727db78583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:40.329198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4edd0-df88-4ee8-9ad4-3d727db78583 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.329528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4edd0-df88-4ee8-9ad4-3d727db78583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.329806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4edd0-df88-4ee8-9ad4-3d727db78583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.330480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4edd0-df88-4ee8-9ad4-3d727db78583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:40.332256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4edd0-df88-4ee8-9ad4-3d727db78583 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:40.352110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1037/2080] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:40.352320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95161d31-7f72-4faa-acd0-7d173c854162 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:40.352720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-95161d31-7f72-4faa-acd0-7d173c854162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:40.358804 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4edd0-df88-4ee8-9ad4-3d727db78583 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:40.376114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:40.386153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95161d31-7f72-4faa-acd0-7d173c854162 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:40.392458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:40.393186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.393412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4edd0-df88-4ee8-9ad4-3d727db78583 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:40.393948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.394176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] PATH_INFO: `/v3/users/93c906c81f2249dea0c1766840e62a5a` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.395452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c906c81f2249dea0c1766840e62a5a)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:40.397429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:40.400947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098f1ab-488d-44d6-8bc2-3a596c91e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:40.401753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098f1ab-488d-44d6-8bc2-3a596c91e019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.402054 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098f1ab-488d-44d6-8bc2-3a596c91e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.402338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098f1ab-488d-44d6-8bc2-3a596c91e019 admin admin] PATH_INFO: `/v3/projects/10bc6d6eddcb485680a1411b0bc05631/users/fd71aec9dd8a4f7cb4a6f51508e4d992/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.404837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098f1ab-488d-44d6-8bc2-3a596c91e019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bc6d6eddcb485680a1411b0bc05631, user_id=fd71aec9dd8a4f7cb4a6f51508e4d992, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:40.407173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098f1ab-488d-44d6-8bc2-3a596c91e019 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:40.414753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:40.425291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1038/2081] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:40 2022] PUT /identity/v3/projects/10bc6d6eddcb485680a1411b0bc05631/users/fd71aec9dd8a4f7cb4a6f51508e4d992/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:40.435017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692e00-06c6-4be2-b3f5-e71a8f4edf8f None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.435229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692e00-06c6-4be2-b3f5-e71a8f4edf8f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.435582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692e00-06c6-4be2-b3f5-e71a8f4edf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.480156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1f692e00-06c6-4be2-b3f5-e71a8f4edf8f None None] MFA Rules not processed for user `fd71aec9dd8a4f7cb4a6f51508e4d992`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:40.481177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1f692e00-06c6-4be2-b3f5-e71a8f4edf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:40.501844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c906c81f2249dea0c1766840e62a5a'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:40.514422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c906c81f2249dea0c1766840e62a5a'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:40.517564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c906c81f2249dea0c1766840e62a5a'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:40.539760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c906c81f2249dea0c1766840e62a5a'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:40.552510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-25b06b1f-ea74-43b8-823b-6eff75760a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c906c81f2249dea0c1766840e62a5a'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:40.561329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1044/2082] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:40 2022] DELETE /identity/v3/users/93c906c81f2249dea0c1766840e62a5a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:40.569740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb34d-6be5-45b1-a57c-dc4e530beccd None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.570279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb34d-6be5-45b1-a57c-dc4e530beccd None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.570676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb34d-6be5-45b1-a57c-dc4e530beccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.595159 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-acffb34d-6be5-45b1-a57c-dc4e530beccd None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:40.598514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-acffb34d-6be5-45b1-a57c-dc4e530beccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:40.625277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1039/2083] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:40.637203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692e00-06c6-4be2-b3f5-e71a8f4edf8f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:40.639939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1f692e00-06c6-4be2-b3f5-e71a8f4edf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:40.683757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1045/2084] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:40.693471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffb34d-6be5-45b1-a57c-dc4e530beccd None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:40.694883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-acffb34d-6be5-45b1-a57c-dc4e530beccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:40.717399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692e00-06c6-4be2-b3f5-e71a8f4edf8f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:40.757971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffb34d-6be5-45b1-a57c-dc4e530beccd None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:40.761733 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53b64-d942-4a15-b228-a4eb4ac95cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:40.762353 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53b64-d942-4a15-b228-a4eb4ac95cce service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.762635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53b64-d942-4a15-b228-a4eb4ac95cce service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.762910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53b64-d942-4a15-b228-a4eb4ac95cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.772467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a118e2-045b-471a-9bb4-51a1ce64f4ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:40.773121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a118e2-045b-471a-9bb4-51a1ce64f4ef service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:40.773453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a118e2-045b-471a-9bb4-51a1ce64f4ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:40.773760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a118e2-045b-471a-9bb4-51a1ce64f4ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:40.774951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53b64-d942-4a15-b228-a4eb4ac95cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:40.776387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53b64-d942-4a15-b228-a4eb4ac95cce service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:40.788040 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1046/2085] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:40.829376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:40.843808 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a118e2-045b-471a-9bb4-51a1ce64f4ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:40.845012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a118e2-045b-471a-9bb4-51a1ce64f4ef service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:40.857130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1040/2086] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:41.159101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53b64-d942-4a15-b228-a4eb4ac95cce service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:41.161420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-65c53b64-d942-4a15-b228-a4eb4ac95cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:41.193716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53b64-d942-4a15-b228-a4eb4ac95cce service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:41.200193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:41.201052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:41.201458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:41.201777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] PATH_INFO: `/v3/projects/548952ee417047e89acb05a84b03cdb0` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:41.203082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=548952ee417047e89acb05a84b03cdb0)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:41.205184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:41.244686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:41.294454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548952ee417047e89acb05a84b03cdb0', 'request_id': 'req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.305003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548952ee417047e89acb05a84b03cdb0', 'request_id': 'req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.338116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548952ee417047e89acb05a84b03cdb0', 'request_id': 'req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.356429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] The token cache is being invalidate because project 548952ee417047e89acb05a84b03cdb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:41.357071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.357909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.359412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1047/2087] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:41 2022] DELETE /identity/v3/projects/548952ee417047e89acb05a84b03cdb0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:41.363484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a118e2-045b-471a-9bb4-51a1ce64f4ef service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:41.374648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a118e2-045b-471a-9bb4-51a1ce64f4ef service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:41.436878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:41.437698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:41.438053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:41.438258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] PATH_INFO: `/v3/users/4e9926f9731346429dab07f467448977` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:41.439414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9926f9731346429dab07f467448977)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:41.441985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:41.501740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9926f9731346429dab07f467448977'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.510905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9926f9731346429dab07f467448977'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.511632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9926f9731346429dab07f467448977'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.530275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9926f9731346429dab07f467448977'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.551973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9926f9731346429dab07f467448977'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:41.562802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1041/2088] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:41 2022] DELETE /identity/v3/users/4e9926f9731346429dab07f467448977 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:41.606680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:41.608354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:41.687132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54584492-60e2-4652-bb0a-9bfc2ecd7c0c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:41.756369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c05030-4392-4250-b9d8-8f5dc0a38a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:41.757097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c05030-4392-4250-b9d8-8f5dc0a38a9a service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:41.757511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c05030-4392-4250-b9d8-8f5dc0a38a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:41.757905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c05030-4392-4250-b9d8-8f5dc0a38a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:41.759894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-22c05030-4392-4250-b9d8-8f5dc0a38a9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:41.827420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c05030-4392-4250-b9d8-8f5dc0a38a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:41.828962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c05030-4392-4250-b9d8-8f5dc0a38a9a service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:41.838671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1048/2089] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:41.907133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:41.908607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:41.996155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476c789-4e50-431e-899a-ca68feb01f1f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:42.001689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:42.002418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.002740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.003025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] PATH_INFO: `/v3/projects/cf7571849828424782295e10ae4ee63c` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.004176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7571849828424782295e10ae4ee63c)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:42.006219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:42.018727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:42.068383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7571849828424782295e10ae4ee63c', 'request_id': 'req-90174a82-56d5-400b-b312-7ab4d7fab5e2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:42.078325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7571849828424782295e10ae4ee63c', 'request_id': 'req-90174a82-56d5-400b-b312-7ab4d7fab5e2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:42.086492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7571849828424782295e10ae4ee63c', 'request_id': 'req-90174a82-56d5-400b-b312-7ab4d7fab5e2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:42.101980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] The token cache is being invalidate because project cf7571849828424782295e10ae4ee63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:42.102284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:42.103194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90174a82-56d5-400b-b312-7ab4d7fab5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:42.114326 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1042/2090] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:41 2022] DELETE /identity/v3/projects/cf7571849828424782295e10ae4ee63c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:42.117738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87dd97-4b40-4f3c-9bf6-0ab4a5709bd3 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.118205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87dd97-4b40-4f3c-9bf6-0ab4a5709bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.118651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87dd97-4b40-4f3c-9bf6-0ab4a5709bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.158562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6b87dd97-4b40-4f3c-9bf6-0ab4a5709bd3 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:42.160335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6b87dd97-4b40-4f3c-9bf6-0ab4a5709bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:42.170370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:42.250044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1049/2091] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:42.259972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773e56-eccc-408a-a5b0-aeeb3ab96572 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.260499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773e56-eccc-408a-a5b0-aeeb3ab96572 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.261068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773e56-eccc-408a-a5b0-aeeb3ab96572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.290150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3e773e56-eccc-408a-a5b0-aeeb3ab96572 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:42.291854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3e773e56-eccc-408a-a5b0-aeeb3ab96572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:42.305297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1043/2092] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:42.311052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87dd97-4b40-4f3c-9bf6-0ab4a5709bd3 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:42.322641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87dd97-4b40-4f3c-9bf6-0ab4a5709bd3 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:42.327658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6fdf1-13b9-4c28-89fe-58d177144145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:42.328274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6fdf1-13b9-4c28-89fe-58d177144145 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.328553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6fdf1-13b9-4c28-89fe-58d177144145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.328823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6fdf1-13b9-4c28-89fe-58d177144145 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.329513 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6fdf1-13b9-4c28-89fe-58d177144145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:42.329815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6fdf1-13b9-4c28-89fe-58d177144145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:42.332083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6fdf1-13b9-4c28-89fe-58d177144145 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:42.349288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1050/2093] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:42.352056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773e56-eccc-408a-a5b0-aeeb3ab96572 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:42.363541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773e56-eccc-408a-a5b0-aeeb3ab96572 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:42.370510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5446e-4a98-4d6e-9f0e-296f1fd6f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:42.371247 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5446e-4a98-4d6e-9f0e-296f1fd6f19f admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.371641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5446e-4a98-4d6e-9f0e-296f1fd6f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.372021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5446e-4a98-4d6e-9f0e-296f1fd6f19f admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.372997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5446e-4a98-4d6e-9f0e-296f1fd6f19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:42.375258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5446e-4a98-4d6e-9f0e-296f1fd6f19f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:42.408435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1044/2094] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:42 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:42.412830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6fdf1-13b9-4c28-89fe-58d177144145 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:42.425014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6fdf1-13b9-4c28-89fe-58d177144145 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:42.495187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042d1b-0ddd-44bf-bc4b-67ec89619cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:42.495810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042d1b-0ddd-44bf-bc4b-67ec89619cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.496089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042d1b-0ddd-44bf-bc4b-67ec89619cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.496365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042d1b-0ddd-44bf-bc4b-67ec89619cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.497041 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b042d1b-0ddd-44bf-bc4b-67ec89619cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:42.499064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b042d1b-0ddd-44bf-bc4b-67ec89619cc9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:42.523091 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1051/2095] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:42 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:42.527633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5446e-4a98-4d6e-9f0e-296f1fd6f19f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:42.539603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5446e-4a98-4d6e-9f0e-296f1fd6f19f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:42.544365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6dc7b-842e-4fe6-879c-c114c1fae5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:42.545057 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6dc7b-842e-4fe6-879c-c114c1fae5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.545379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6dc7b-842e-4fe6-879c-c114c1fae5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.545662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6dc7b-842e-4fe6-879c-c114c1fae5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.546351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6dc7b-842e-4fe6-879c-c114c1fae5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:42.548021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6dc7b-842e-4fe6-879c-c114c1fae5fb admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:42.559046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1045/2096] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:42.566900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042d1b-0ddd-44bf-bc4b-67ec89619cc9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:42.577975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042d1b-0ddd-44bf-bc4b-67ec89619cc9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:42.582981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fbeab-acc0-4828-8616-4b68587a1630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:42.583625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fbeab-acc0-4828-8616-4b68587a1630 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.584034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fbeab-acc0-4828-8616-4b68587a1630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.584312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fbeab-acc0-4828-8616-4b68587a1630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.584959 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fbeab-acc0-4828-8616-4b68587a1630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:42.586584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fbeab-acc0-4828-8616-4b68587a1630 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:42.598770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1052/2097] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:42.603093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6dc7b-842e-4fe6-879c-c114c1fae5fb admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:42.613476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6dc7b-842e-4fe6-879c-c114c1fae5fb admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:42.618223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a5bb-ce0b-426b-b060-96aa65fad810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:42.618883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a5bb-ce0b-426b-b060-96aa65fad810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.619163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a5bb-ce0b-426b-b060-96aa65fad810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.619436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a5bb-ce0b-426b-b060-96aa65fad810 admin admin] PATH_INFO: `/v3/projects/5e51662748b241d8b2bd2e0ea86529ed/users/14a13895eeba44d3b450774ba29f57e4/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.635273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27a5bb-ce0b-426b-b060-96aa65fad810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e51662748b241d8b2bd2e0ea86529ed, user_id=14a13895eeba44d3b450774ba29f57e4, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:42.637964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27a5bb-ce0b-426b-b060-96aa65fad810 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:42.652085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1046/2098] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:42 2022] PUT /identity/v3/projects/5e51662748b241d8b2bd2e0ea86529ed/users/14a13895eeba44d3b450774ba29f57e4/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:42.663595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1938193-1399-4ddc-93c8-2f3bea45503e None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.663883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1938193-1399-4ddc-93c8-2f3bea45503e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.664161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1938193-1399-4ddc-93c8-2f3bea45503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.694842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d1938193-1399-4ddc-93c8-2f3bea45503e None None] MFA Rules not processed for user `14a13895eeba44d3b450774ba29f57e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:42.696158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d1938193-1399-4ddc-93c8-2f3bea45503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:42.793320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1053/2099] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:42.795585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a5bb-ce0b-426b-b060-96aa65fad810 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:42.797366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-0a27a5bb-ce0b-426b-b060-96aa65fad810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:42.873199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a5bb-ce0b-426b-b060-96aa65fad810 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:42.877128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017140f1-113c-4a59-82ba-6c6b539c00c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:42.878694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017140f1-113c-4a59-82ba-6c6b539c00c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:42.879011 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017140f1-113c-4a59-82ba-6c6b539c00c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:42.879361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017140f1-113c-4a59-82ba-6c6b539c00c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:42.898469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017140f1-113c-4a59-82ba-6c6b539c00c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:42.899933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017140f1-113c-4a59-82ba-6c6b539c00c8 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:42.910023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1047/2100] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:42.937621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1938193-1399-4ddc-93c8-2f3bea45503e None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:42.948602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:43.014132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1938193-1399-4ddc-93c8-2f3bea45503e None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:43.018847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:43.019486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:43.019773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:43.020084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] PATH_INFO: `/v3/users/14a13895eeba44d3b450774ba29f57e4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:43.021935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a13895eeba44d3b450774ba29f57e4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:43.023929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:43.072400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a13895eeba44d3b450774ba29f57e4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.079930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a13895eeba44d3b450774ba29f57e4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.080589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a13895eeba44d3b450774ba29f57e4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.095897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a13895eeba44d3b450774ba29f57e4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.104494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a13895eeba44d3b450774ba29f57e4'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.111186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1054/2101] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:42 2022] DELETE /identity/v3/users/14a13895eeba44d3b450774ba29f57e4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:43.117121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6a2f-2d9f-43af-8ea7-dc666b2fe276 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:43.117578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6a2f-2d9f-43af-8ea7-dc666b2fe276 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:43.117994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6a2f-2d9f-43af-8ea7-dc666b2fe276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:43.144727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f7ac6a2f-2d9f-43af-8ea7-dc666b2fe276 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:43.146317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f7ac6a2f-2d9f-43af-8ea7-dc666b2fe276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:43.188691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:43.232619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1048/2102] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:43.243665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:43.245132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:43.327533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e70789-63e3-4540-9468-f83b93348498 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:43.331222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d60934-cf8c-4938-bf21-a6dc8ea459f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:43.331818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d60934-cf8c-4938-bf21-a6dc8ea459f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:43.332097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d60934-cf8c-4938-bf21-a6dc8ea459f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:43.332369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d60934-cf8c-4938-bf21-a6dc8ea459f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:43.342405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d60934-cf8c-4938-bf21-a6dc8ea459f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:43.343857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d60934-cf8c-4938-bf21-a6dc8ea459f2 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:43.355361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1055/2103] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:43.663489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6a2f-2d9f-43af-8ea7-dc666b2fe276 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:43.665344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f7ac6a2f-2d9f-43af-8ea7-dc666b2fe276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:43.689372 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6a2f-2d9f-43af-8ea7-dc666b2fe276 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:43.701966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:43.703406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:43.703406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:43.703769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] PATH_INFO: `/v3/projects/5e51662748b241d8b2bd2e0ea86529ed` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:43.705360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e51662748b241d8b2bd2e0ea86529ed)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:43.711643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:43.767966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e51662748b241d8b2bd2e0ea86529ed', 'request_id': 'req-f64cf478-1cd4-40df-a81b-722e77b8a3f9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.776914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e51662748b241d8b2bd2e0ea86529ed', 'request_id': 'req-f64cf478-1cd4-40df-a81b-722e77b8a3f9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.782893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e51662748b241d8b2bd2e0ea86529ed', 'request_id': 'req-f64cf478-1cd4-40df-a81b-722e77b8a3f9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.795379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] The token cache is being invalidate because project 5e51662748b241d8b2bd2e0ea86529ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:43.795747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.796335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f64cf478-1cd4-40df-a81b-722e77b8a3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:43.798214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1049/2104] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:43 2022] DELETE /identity/v3/projects/5e51662748b241d8b2bd2e0ea86529ed => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:43.804412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c93116-f4f1-48ee-abc1-38de80a63565 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:43.804726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c93116-f4f1-48ee-abc1-38de80a63565 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:43.805145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c93116-f4f1-48ee-abc1-38de80a63565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:43.825873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-42c93116-f4f1-48ee-abc1-38de80a63565 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:43.827138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-42c93116-f4f1-48ee-abc1-38de80a63565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:43.855282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:43.898454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1056/2105] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:43.907542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c7bc-b73a-444c-b111-1bfd2979daa8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:43.907755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c7bc-b73a-444c-b111-1bfd2979daa8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:43.908077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c7bc-b73a-444c-b111-1bfd2979daa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:43.929854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f133c7bc-b73a-444c-b111-1bfd2979daa8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:43.931112 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f133c7bc-b73a-444c-b111-1bfd2979daa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:43.939483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1050/2106] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:43.944909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c93116-f4f1-48ee-abc1-38de80a63565 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:43.956683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c93116-f4f1-48ee-abc1-38de80a63565 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:43.962222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013f02f-5730-4d6a-a341-c173270b68e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:43.962920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013f02f-5730-4d6a-a341-c173270b68e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:43.963203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013f02f-5730-4d6a-a341-c173270b68e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:43.963484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013f02f-5730-4d6a-a341-c173270b68e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:43.964135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013f02f-5730-4d6a-a341-c173270b68e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:43.964510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013f02f-5730-4d6a-a341-c173270b68e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:43.966163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013f02f-5730-4d6a-a341-c173270b68e0 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:43.983877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1057/2107] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:43.985442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133c7bc-b73a-444c-b111-1bfd2979daa8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:43.995184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133c7bc-b73a-444c-b111-1bfd2979daa8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:44.002413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb61aa-4f7b-4bfd-b850-c6877a998152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:44.003117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb61aa-4f7b-4bfd-b850-c6877a998152 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:44.004733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb61aa-4f7b-4bfd-b850-c6877a998152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:44.004733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb61aa-4f7b-4bfd-b850-c6877a998152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:44.004733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb61aa-4f7b-4bfd-b850-c6877a998152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:44.006437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb61aa-4f7b-4bfd-b850-c6877a998152 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:44.048292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1051/2108] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:43 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:44.051354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013f02f-5730-4d6a-a341-c173270b68e0 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:44.076354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013f02f-5730-4d6a-a341-c173270b68e0 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:44.192077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88c70-e0f9-4f74-bd0e-0a532b2704f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:44.198328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88c70-e0f9-4f74-bd0e-0a532b2704f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:44.198795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88c70-e0f9-4f74-bd0e-0a532b2704f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:44.201590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88c70-e0f9-4f74-bd0e-0a532b2704f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:44.202756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88c70-e0f9-4f74-bd0e-0a532b2704f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:44.208400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88c70-e0f9-4f74-bd0e-0a532b2704f4 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:44.267360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1058/2109] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:44 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:44.268348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb61aa-4f7b-4bfd-b850-c6877a998152 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:44.282756 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb61aa-4f7b-4bfd-b850-c6877a998152 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:44.293481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5841f6-d1cf-4fd7-8baa-ffd4c15ba22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:44.295623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5841f6-d1cf-4fd7-8baa-ffd4c15ba22c admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:44.296085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5841f6-d1cf-4fd7-8baa-ffd4c15ba22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:44.296718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5841f6-d1cf-4fd7-8baa-ffd4c15ba22c admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:44.297990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5841f6-d1cf-4fd7-8baa-ffd4c15ba22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:44.299731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5841f6-d1cf-4fd7-8baa-ffd4c15ba22c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:44.322586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1052/2110] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:44.327631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88c70-e0f9-4f74-bd0e-0a532b2704f4 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:44.340140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88c70-e0f9-4f74-bd0e-0a532b2704f4 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:44.345995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae5cbd-4515-47eb-957b-56db754591b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:44.346939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5cbd-4515-47eb-957b-56db754591b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:44.347371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5cbd-4515-47eb-957b-56db754591b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:44.347823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5cbd-4515-47eb-957b-56db754591b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:44.348567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae5cbd-4515-47eb-957b-56db754591b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:44.350462 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae5cbd-4515-47eb-957b-56db754591b6 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:44.374176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1059/2111] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:44.376785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5841f6-d1cf-4fd7-8baa-ffd4c15ba22c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:44.392996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5841f6-d1cf-4fd7-8baa-ffd4c15ba22c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:44.400140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8581e-483e-4e9e-81de-88cc18a9c3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:44.400999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8581e-483e-4e9e-81de-88cc18a9c3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:44.401490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8581e-483e-4e9e-81de-88cc18a9c3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:44.401929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8581e-483e-4e9e-81de-88cc18a9c3c7 admin admin] PATH_INFO: `/v3/projects/ed9b8d4281304d549fc456004841b87c/users/520a42995dc7492abdff83c27c5c6919/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:44.423447 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8581e-483e-4e9e-81de-88cc18a9c3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9b8d4281304d549fc456004841b87c, user_id=520a42995dc7492abdff83c27c5c6919, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:44.426857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8581e-483e-4e9e-81de-88cc18a9c3c7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:44.446949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1053/2112] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:44 2022] PUT /identity/v3/projects/ed9b8d4281304d549fc456004841b87c/users/520a42995dc7492abdff83c27c5c6919/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:44.460381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1a993-9ceb-4fbd-9aa9-9239aa789d03 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:44.460852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1a993-9ceb-4fbd-9aa9-9239aa789d03 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:44.466672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1a993-9ceb-4fbd-9aa9-9239aa789d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:44.538089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-0ac1a993-9ceb-4fbd-9aa9-9239aa789d03 None None] MFA Rules not processed for user `520a42995dc7492abdff83c27c5c6919`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:44.539444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0ac1a993-9ceb-4fbd-9aa9-9239aa789d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:44.649283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1060/2113] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:44.660030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8581e-483e-4e9e-81de-88cc18a9c3c7 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:44.662170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-85a8581e-483e-4e9e-81de-88cc18a9c3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:44.814153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8581e-483e-4e9e-81de-88cc18a9c3c7 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:44.831404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0933f-6801-46e3-818d-988aa51dec78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:44.832428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0933f-6801-46e3-818d-988aa51dec78 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:44.832854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0933f-6801-46e3-818d-988aa51dec78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:44.833295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0933f-6801-46e3-818d-988aa51dec78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:44.849938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0933f-6801-46e3-818d-988aa51dec78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:44.851448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0933f-6801-46e3-818d-988aa51dec78 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:44.871528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:44.896701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1054/2114] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:46.275205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1a993-9ceb-4fbd-9aa9-9239aa789d03 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:46.280078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0ac1a993-9ceb-4fbd-9aa9-9239aa789d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:46.302133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1a993-9ceb-4fbd-9aa9-9239aa789d03 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:46.308989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b7bb4-3bc9-4f08-af9e-121cda39d3f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:46.310162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b7bb4-3bc9-4f08-af9e-121cda39d3f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:46.310656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b7bb4-3bc9-4f08-af9e-121cda39d3f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:46.311138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b7bb4-3bc9-4f08-af9e-121cda39d3f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:46.314097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a68b7bb4-3bc9-4f08-af9e-121cda39d3f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:46.354525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:46.419917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b7bb4-3bc9-4f08-af9e-121cda39d3f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:46.422271 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b7bb4-3bc9-4f08-af9e-121cda39d3f6 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:46.436727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1061/2115] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:48.931499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0933f-6801-46e3-818d-988aa51dec78 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:48.932927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a7c0933f-6801-46e3-818d-988aa51dec78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:49.001978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0933f-6801-46e3-818d-988aa51dec78 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:49.007013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:49.007651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:49.007933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:49.008208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] PATH_INFO: `/v3/users/0eea94599a3649b78e30a199273d8e3e` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:49.009406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eea94599a3649b78e30a199273d8e3e)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:49.011322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:49.056899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eea94599a3649b78e30a199273d8e3e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.064648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eea94599a3649b78e30a199273d8e3e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.066037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eea94599a3649b78e30a199273d8e3e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.078684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eea94599a3649b78e30a199273d8e3e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.085530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eea94599a3649b78e30a199273d8e3e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.091507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1055/2116] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:48 2022] DELETE /identity/v3/users/0eea94599a3649b78e30a199273d8e3e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:49.096112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a7df4-8c09-46af-ab4e-288ffd1c1b72 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:49.096616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a7df4-8c09-46af-ab4e-288ffd1c1b72 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:49.096708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a7df4-8c09-46af-ab4e-288ffd1c1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:49.117308 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-9d8a7df4-8c09-46af-ab4e-288ffd1c1b72 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:49.118528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9d8a7df4-8c09-46af-ab4e-288ffd1c1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:49.193592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1062/2117] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:49.203346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:49.204817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:49.267969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897f224-95cb-4380-9df4-49593caf4f0f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:49.272392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95fbb4-3676-4d60-8ab3-ca6fd28ce0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:49.273032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95fbb4-3676-4d60-8ab3-ca6fd28ce0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:49.273345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95fbb4-3676-4d60-8ab3-ca6fd28ce0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:49.273621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95fbb4-3676-4d60-8ab3-ca6fd28ce0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:49.285251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95fbb4-3676-4d60-8ab3-ca6fd28ce0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:49.288029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95fbb4-3676-4d60-8ab3-ca6fd28ce0b2 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:49.306177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1056/2118] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:49.646016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a7df4-8c09-46af-ab4e-288ffd1c1b72 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:49.647470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9d8a7df4-8c09-46af-ab4e-288ffd1c1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:49.685613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a7df4-8c09-46af-ab4e-288ffd1c1b72 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:49.695140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:49.696248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:49.696722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:49.697283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] PATH_INFO: `/v3/projects/de3fb80660ef4d6a9cf97487082c7dc4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:49.698789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3fb80660ef4d6a9cf97487082c7dc4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:49.701031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:49.800301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3fb80660ef4d6a9cf97487082c7dc4', 'request_id': 'req-8ff723d9-5aae-4535-aa0e-1023edcafbd3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.810418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3fb80660ef4d6a9cf97487082c7dc4', 'request_id': 'req-8ff723d9-5aae-4535-aa0e-1023edcafbd3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.819007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3fb80660ef4d6a9cf97487082c7dc4', 'request_id': 'req-8ff723d9-5aae-4535-aa0e-1023edcafbd3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.836316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] The token cache is being invalidate because project de3fb80660ef4d6a9cf97487082c7dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:49.836634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.837310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:49.838827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1063/2119] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:49 2022] DELETE /identity/v3/projects/de3fb80660ef4d6a9cf97487082c7dc4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:49.843034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95fbb4-3676-4d60-8ab3-ca6fd28ce0b2 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:49.856806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95fbb4-3676-4d60-8ab3-ca6fd28ce0b2 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:49.879620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:49.936336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:49.936969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:49.936969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:49.937371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] PATH_INFO: `/v3/users/624dbfc5433b493c86bfefaec7a01b90` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:49.938485 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=624dbfc5433b493c86bfefaec7a01b90)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:49.940459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:49.999887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624dbfc5433b493c86bfefaec7a01b90'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.008365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624dbfc5433b493c86bfefaec7a01b90'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.009087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624dbfc5433b493c86bfefaec7a01b90'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.031735 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624dbfc5433b493c86bfefaec7a01b90'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.040552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624dbfc5433b493c86bfefaec7a01b90'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.047743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1057/2120] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:49 2022] DELETE /identity/v3/users/624dbfc5433b493c86bfefaec7a01b90 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:50.406598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:50.408254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:50.442018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff723d9-5aae-4535-aa0e-1023edcafbd3 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:50.497180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:50.512939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:50.514695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:50.515178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:50.515638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] PATH_INFO: `/v3/projects/4174f17697324cbcbb0dd5d980f9fded` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:50.517127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4174f17697324cbcbb0dd5d980f9fded)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:50.533439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:50.594898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4174f17697324cbcbb0dd5d980f9fded', 'request_id': 'req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.605145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4174f17697324cbcbb0dd5d980f9fded', 'request_id': 'req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.610538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4174f17697324cbcbb0dd5d980f9fded', 'request_id': 'req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.627294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] The token cache is being invalidate because project 4174f17697324cbcbb0dd5d980f9fded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:50.628437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.629147 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.630975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1064/2121] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:50 2022] DELETE /identity/v3/projects/4174f17697324cbcbb0dd5d980f9fded => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:50.635594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:50.637259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:50.651072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0639b1e-3e0c-47e3-8a64-acc28d1b4efa admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:50.733310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:50.735430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:50.735430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:50.735430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] PATH_INFO: `/v3/users/fd71aec9dd8a4f7cb4a6f51508e4d992` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:50.736446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd71aec9dd8a4f7cb4a6f51508e4d992)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:50.739160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:50.841550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:50.848542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd71aec9dd8a4f7cb4a6f51508e4d992'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.866715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd71aec9dd8a4f7cb4a6f51508e4d992'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.867888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd71aec9dd8a4f7cb4a6f51508e4d992'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.888039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd71aec9dd8a4f7cb4a6f51508e4d992'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.897358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a2d7bd1f-2f87-4222-8711-514ad026b9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd71aec9dd8a4f7cb4a6f51508e4d992'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:50.903720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1058/2122] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:50 2022] DELETE /identity/v3/users/fd71aec9dd8a4f7cb4a6f51508e4d992 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:51.303301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:51.305021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:51.332883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dd74f-8e02-4329-87a1-e4ae84648f6c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:51.429537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:51.430303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:51.431000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:51.432013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] PATH_INFO: `/v3/projects/10bc6d6eddcb485680a1411b0bc05631` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:51.436265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bc6d6eddcb485680a1411b0bc05631)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:51.438509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:51.509362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bc6d6eddcb485680a1411b0bc05631', 'request_id': 'req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:51.523883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bc6d6eddcb485680a1411b0bc05631', 'request_id': 'req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:51.532882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bc6d6eddcb485680a1411b0bc05631', 'request_id': 'req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:51.558750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] The token cache is being invalidate because project 10bc6d6eddcb485680a1411b0bc05631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:51.559052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:51.560079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-4d0b2fbe-afc9-4797-8f27-c8afd0983ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:51.562139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1065/2123] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:51 2022] DELETE /identity/v3/projects/10bc6d6eddcb485680a1411b0bc05631 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:51.569721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afd73-2fc8-412a-9c55-d97a933c3e60 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:51.570283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afd73-2fc8-412a-9c55-d97a933c3e60 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:51.571032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afd73-2fc8-412a-9c55-d97a933c3e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:51.596938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3b4afd73-2fc8-412a-9c55-d97a933c3e60 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:51.598728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3b4afd73-2fc8-412a-9c55-d97a933c3e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:51.681334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1059/2124] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:51.690146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83db6-a7f5-4ef1-bda7-17d5c21333bb None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:51.690880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83db6-a7f5-4ef1-bda7-17d5c21333bb None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:51.691355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83db6-a7f5-4ef1-bda7-17d5c21333bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:51.714361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-5eb83db6-a7f5-4ef1-bda7-17d5c21333bb None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:51.715693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5eb83db6-a7f5-4ef1-bda7-17d5c21333bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:51.725695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1066/2125] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:51.737738 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4afd73-2fc8-412a-9c55-d97a933c3e60 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:51.750819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4afd73-2fc8-412a-9c55-d97a933c3e60 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:51.757049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dcb61-5588-4ef2-9e73-0c3da6474d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:51.757941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dcb61-5588-4ef2-9e73-0c3da6474d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:51.758436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dcb61-5588-4ef2-9e73-0c3da6474d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:51.759159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dcb61-5588-4ef2-9e73-0c3da6474d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:51.760036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dcb61-5588-4ef2-9e73-0c3da6474d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:51.761019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dcb61-5588-4ef2-9e73-0c3da6474d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:51.763824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dcb61-5588-4ef2-9e73-0c3da6474d0c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:51.794137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1060/2126] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:51.798648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83db6-a7f5-4ef1-bda7-17d5c21333bb None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:51.804038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:51.813689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83db6-a7f5-4ef1-bda7-17d5c21333bb None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:51.819811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193e601-1061-4634-ad74-4d6bfcc376cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:51.821325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193e601-1061-4634-ad74-4d6bfcc376cc admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:51.821765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193e601-1061-4634-ad74-4d6bfcc376cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:51.822138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193e601-1061-4634-ad74-4d6bfcc376cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:51.822927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193e601-1061-4634-ad74-4d6bfcc376cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:51.825620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193e601-1061-4634-ad74-4d6bfcc376cc admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:51.863895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1067/2127] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:51 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:51.868103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dcb61-5588-4ef2-9e73-0c3da6474d0c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:51.907596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dcb61-5588-4ef2-9e73-0c3da6474d0c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.043882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b380c9a-0d1f-4a79-a90c-3b5a7ec7a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.048332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b380c9a-0d1f-4a79-a90c-3b5a7ec7a6ba admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.048692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b380c9a-0d1f-4a79-a90c-3b5a7ec7a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.048971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b380c9a-0d1f-4a79-a90c-3b5a7ec7a6ba admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.049817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b380c9a-0d1f-4a79-a90c-3b5a7ec7a6ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.051876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b380c9a-0d1f-4a79-a90c-3b5a7ec7a6ba admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.089892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1061/2128] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:51 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:52.094005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193e601-1061-4634-ad74-4d6bfcc376cc admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:52.107721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193e601-1061-4634-ad74-4d6bfcc376cc admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.119152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a073-98b0-408c-860f-d84402a21e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.120652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a073-98b0-408c-860f-d84402a21e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.121143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a073-98b0-408c-860f-d84402a21e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.121515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a073-98b0-408c-860f-d84402a21e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.122794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912a073-98b0-408c-860f-d84402a21e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.126212 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912a073-98b0-408c-860f-d84402a21e72 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.144507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1068/2129] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:52.146547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b380c9a-0d1f-4a79-a90c-3b5a7ec7a6ba admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:52.157862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b380c9a-0d1f-4a79-a90c-3b5a7ec7a6ba admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.168452 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce5795-0f39-411d-b990-bf1ab05f1c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.169278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce5795-0f39-411d-b990-bf1ab05f1c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.169704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce5795-0f39-411d-b990-bf1ab05f1c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.170258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce5795-0f39-411d-b990-bf1ab05f1c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.171174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce5795-0f39-411d-b990-bf1ab05f1c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.172951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce5795-0f39-411d-b990-bf1ab05f1c9d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.199635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1062/2130] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:52.200211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a073-98b0-408c-860f-d84402a21e72 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:52.217428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a073-98b0-408c-860f-d84402a21e72 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.234830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bac6f-0737-4ae0-8fa0-90e925c39e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.234830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bac6f-0737-4ae0-8fa0-90e925c39e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.234830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bac6f-0737-4ae0-8fa0-90e925c39e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.234830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bac6f-0737-4ae0-8fa0-90e925c39e83 admin admin] PATH_INFO: `/v3/projects/7ab8b41297aa44ecb60b25c06338a6a8/users/711c0ca594df41c6ba91590720fdef37/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.258250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bac6f-0737-4ae0-8fa0-90e925c39e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab8b41297aa44ecb60b25c06338a6a8, user_id=711c0ca594df41c6ba91590720fdef37, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.261089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bac6f-0737-4ae0-8fa0-90e925c39e83 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.279520 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1069/2131] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:52 2022] PUT /identity/v3/projects/7ab8b41297aa44ecb60b25c06338a6a8/users/711c0ca594df41c6ba91590720fdef37/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:52.293622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d1976-4aa1-47d9-b464-4d442d0366bf None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.300440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d1976-4aa1-47d9-b464-4d442d0366bf None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.300745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d1976-4aa1-47d9-b464-4d442d0366bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.339871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-dd1d1976-4aa1-47d9-b464-4d442d0366bf None None] MFA Rules not processed for user `711c0ca594df41c6ba91590720fdef37`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:52.341746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dd1d1976-4aa1-47d9-b464-4d442d0366bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:52.363686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:52.426096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1063/2132] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:52.431413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bac6f-0737-4ae0-8fa0-90e925c39e83 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:52.508924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bac6f-0737-4ae0-8fa0-90e925c39e83 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.514515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aaa21-364f-4001-a62c-7ec34c4dfb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.515147 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aaa21-364f-4001-a62c-7ec34c4dfb6c admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.516386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aaa21-364f-4001-a62c-7ec34c4dfb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.517606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aaa21-364f-4001-a62c-7ec34c4dfb6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.517737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aaa21-364f-4001-a62c-7ec34c4dfb6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.520834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aaa21-364f-4001-a62c-7ec34c4dfb6c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.559347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1070/2133] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:52 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:52.560770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d1976-4aa1-47d9-b464-4d442d0366bf None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:52.577605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d1976-4aa1-47d9-b464-4d442d0366bf None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.649557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f1da-17d6-4a0c-92ed-78fd4ab776cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.650261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f1da-17d6-4a0c-92ed-78fd4ab776cd admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.650620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f1da-17d6-4a0c-92ed-78fd4ab776cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.650970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f1da-17d6-4a0c-92ed-78fd4ab776cd admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.651691 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021f1da-17d6-4a0c-92ed-78fd4ab776cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.653776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021f1da-17d6-4a0c-92ed-78fd4ab776cd admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.685357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1064/2134] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:52 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:52.689397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aaa21-364f-4001-a62c-7ec34c4dfb6c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:52.700792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aaa21-364f-4001-a62c-7ec34c4dfb6c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.706974 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce53e-2133-485f-826e-fc674caf30e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.707844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce53e-2133-485f-826e-fc674caf30e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.708200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce53e-2133-485f-826e-fc674caf30e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.708543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce53e-2133-485f-826e-fc674caf30e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.709373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bce53e-2133-485f-826e-fc674caf30e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.711187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bce53e-2133-485f-826e-fc674caf30e0 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.727156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1071/2135] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:52.731427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f1da-17d6-4a0c-92ed-78fd4ab776cd admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:52.745460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f1da-17d6-4a0c-92ed-78fd4ab776cd admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.751612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e467b2a-2ac6-42c9-aa8c-23414b36451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.752294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e467b2a-2ac6-42c9-aa8c-23414b36451a admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.752624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e467b2a-2ac6-42c9-aa8c-23414b36451a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.752883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e467b2a-2ac6-42c9-aa8c-23414b36451a admin admin] PATH_INFO: `/v3/projects/893d44cef9a74205b7eaac6edfeec1ce/users/4d0460e746f34786a49babd75117d665/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.773568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e467b2a-2ac6-42c9-aa8c-23414b36451a admin admin] RBAC: Authorizing `identity:create_grant(project_id=893d44cef9a74205b7eaac6edfeec1ce, user_id=4d0460e746f34786a49babd75117d665, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.780099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e467b2a-2ac6-42c9-aa8c-23414b36451a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.805369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1065/2136] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:52 2022] PUT /identity/v3/projects/893d44cef9a74205b7eaac6edfeec1ce/users/4d0460e746f34786a49babd75117d665/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:52.808536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce53e-2133-485f-826e-fc674caf30e0 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:52.832327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce53e-2133-485f-826e-fc674caf30e0 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.904104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab621a6-6337-4327-9c39-af2bf027a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.905135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab621a6-6337-4327-9c39-af2bf027a5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.905135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab621a6-6337-4327-9c39-af2bf027a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.910158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab621a6-6337-4327-9c39-af2bf027a5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.912370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab621a6-6337-4327-9c39-af2bf027a5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.914865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab621a6-6337-4327-9c39-af2bf027a5f6 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.927620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1072/2137] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:52.931950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e467b2a-2ac6-42c9-aa8c-23414b36451a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:52.953917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e467b2a-2ac6-42c9-aa8c-23414b36451a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:52.962925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1d1d8-5c43-43db-80cc-d5d3316e0c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:52.963809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1d1d8-5c43-43db-80cc-d5d3316e0c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:52.964300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1d1d8-5c43-43db-80cc-d5d3316e0c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:52.964627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1d1d8-5c43-43db-80cc-d5d3316e0c0b admin admin] PATH_INFO: `/v3/projects/893d44cef9a74205b7eaac6edfeec1ce/users/4d0460e746f34786a49babd75117d665/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:52.967295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1d1d8-5c43-43db-80cc-d5d3316e0c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=893d44cef9a74205b7eaac6edfeec1ce, user_id=4d0460e746f34786a49babd75117d665, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:52.971915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1d1d8-5c43-43db-80cc-d5d3316e0c0b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:52.991659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1066/2138] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:52 2022] PUT /identity/v3/projects/893d44cef9a74205b7eaac6edfeec1ce/users/4d0460e746f34786a49babd75117d665/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:53.016211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5836-c2a7-4041-8cf7-e8b1e236550b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:53.016499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5836-c2a7-4041-8cf7-e8b1e236550b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:53.017439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5836-c2a7-4041-8cf7-e8b1e236550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:53.049346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-358f5836-c2a7-4041-8cf7-e8b1e236550b None None] MFA Rules not processed for user `4d0460e746f34786a49babd75117d665`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:53.051148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-358f5836-c2a7-4041-8cf7-e8b1e236550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:53.063075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:53.155263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1073/2139] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:53.166040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1d1d8-5c43-43db-80cc-d5d3316e0c0b admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:53.168307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2fe1d1d8-5c43-43db-80cc-d5d3316e0c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:53.243929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1d1d8-5c43-43db-80cc-d5d3316e0c0b admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:53.248539 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4f97e-7125-4b8f-882e-dd7fd152855c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:53.249390 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4f97e-7125-4b8f-882e-dd7fd152855c service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:53.249561 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4f97e-7125-4b8f-882e-dd7fd152855c service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:53.249745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4f97e-7125-4b8f-882e-dd7fd152855c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:53.260679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4f97e-7125-4b8f-882e-dd7fd152855c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:53.262163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4f97e-7125-4b8f-882e-dd7fd152855c service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:53.275255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1067/2140] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:53.391197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f5836-c2a7-4041-8cf7-e8b1e236550b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:53.402351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f5836-c2a7-4041-8cf7-e8b1e236550b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:53.407144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951681d-d962-43a1-88e7-bb828893d541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:53.407840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951681d-d962-43a1-88e7-bb828893d541 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:53.408194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951681d-d962-43a1-88e7-bb828893d541 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:53.408552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951681d-d962-43a1-88e7-bb828893d541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:53.476223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951681d-d962-43a1-88e7-bb828893d541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:53.478553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951681d-d962-43a1-88e7-bb828893d541 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:53.491034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1074/2141] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:54.925335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bd80-1611-414a-9804-041563f2aefe None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:54.927192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bd80-1611-414a-9804-041563f2aefe None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:54.927551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bd80-1611-414a-9804-041563f2aefe None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:54.929803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1068/2142] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:26:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:26:54.943672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c437a2-3baa-4570-b91d-bcdde6cbb724 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:54.944471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c437a2-3baa-4570-b91d-bcdde6cbb724 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:54.944742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c437a2-3baa-4570-b91d-bcdde6cbb724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:54.994035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-81c437a2-3baa-4570-b91d-bcdde6cbb724 None None] MFA Rules not processed for user `e42268a8b5944cbd9508a07c037112e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:55.002911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-81c437a2-3baa-4570-b91d-bcdde6cbb724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:55.015715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114bd80-1611-414a-9804-041563f2aefe None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:55.019099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e114bd80-1611-414a-9804-041563f2aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:55.042151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:55.129094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114bd80-1611-414a-9804-041563f2aefe None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:55.136830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1075/2143] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:26:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:55.138449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:55.139307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:55.139597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:55.139881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] PATH_INFO: `/v3/users/84194be302944432b193bdbfd2e6ddf7` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:55.141086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84194be302944432b193bdbfd2e6ddf7)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:55.146062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:55.152737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152c55b-1ff7-409f-9abb-b8d01c3de1db None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:55.152737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152c55b-1ff7-409f-9abb-b8d01c3de1db None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:55.153127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152c55b-1ff7-409f-9abb-b8d01c3de1db None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:55.154552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1076/2144] 10.222.0.61 () {54 vars in 961 bytes} [Thu Sep 22 18:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:26:55.160920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfddff-df71-4286-921b-367244a055c7 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:55.161209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfddff-df71-4286-921b-367244a055c7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:55.162113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfddff-df71-4286-921b-367244a055c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:55.202336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-b4dfddff-df71-4286-921b-367244a055c7 None None] MFA Rules not processed for user `e42268a8b5944cbd9508a07c037112e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:55.204190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b4dfddff-df71-4286-921b-367244a055c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:55.214665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1077/2145] 10.222.0.61 () {58 vars in 1058 bytes} [Thu Sep 22 18:26:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:55.222799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfddff-df71-4286-921b-367244a055c7 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:55.233178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfddff-df71-4286-921b-367244a055c7 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:55.236527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84194be302944432b193bdbfd2e6ddf7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.239301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b4a3-dc6b-4280-b372-60561744215c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:55.239551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b4a3-dc6b-4280-b372-60561744215c service placement] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:55.239837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b4a3-dc6b-4280-b372-60561744215c service placement] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:55.240372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b4a3-dc6b-4280-b372-60561744215c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:55.248824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84194be302944432b193bdbfd2e6ddf7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.249577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84194be302944432b193bdbfd2e6ddf7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.254828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b4a3-dc6b-4280-b372-60561744215c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:55.256830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b4a3-dc6b-4280-b372-60561744215c service placement] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:55.267815 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84194be302944432b193bdbfd2e6ddf7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.269365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1078/2146] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:55.277036 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-482655bb-4538-45c4-817d-cdf684e5a1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84194be302944432b193bdbfd2e6ddf7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.283419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1069/2147] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:55 2022] DELETE /identity/v3/users/84194be302944432b193bdbfd2e6ddf7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:55.514749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b4a3-dc6b-4280-b372-60561744215c service placement] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:55.527983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b4a3-dc6b-4280-b372-60561744215c service placement] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:55.544399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:55.599622 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:55.600286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:55.600667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:55.600941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] PATH_INFO: `/v3/projects/6f21a188f8ab4f61980edbbae4bec22b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:55.602185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f21a188f8ab4f61980edbbae4bec22b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:55.604461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:55.658364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f21a188f8ab4f61980edbbae4bec22b', 'request_id': 'req-077c1ce4-699a-4bcf-809e-608558e9f40c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.665363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f21a188f8ab4f61980edbbae4bec22b', 'request_id': 'req-077c1ce4-699a-4bcf-809e-608558e9f40c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.671792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f21a188f8ab4f61980edbbae4bec22b', 'request_id': 'req-077c1ce4-699a-4bcf-809e-608558e9f40c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.685787 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] The token cache is being invalidate because project 6f21a188f8ab4f61980edbbae4bec22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:55.686115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.686823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-077c1ce4-699a-4bcf-809e-608558e9f40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:55.688361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1079/2148] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:55 2022] DELETE /identity/v3/projects/6f21a188f8ab4f61980edbbae4bec22b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:55.694092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84d75-83c0-4904-8459-cb2637a47130 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:55.694380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84d75-83c0-4904-8459-cb2637a47130 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:55.694702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84d75-83c0-4904-8459-cb2637a47130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:55.718406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-dff84d75-83c0-4904-8459-cb2637a47130 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:55.719673 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dff84d75-83c0-4904-8459-cb2637a47130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:55.801465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1070/2149] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:55.802854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe14df4-e44b-4d24-8db7-2fb0df75659a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:55.803153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe14df4-e44b-4d24-8db7-2fb0df75659a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:55.803441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe14df4-e44b-4d24-8db7-2fb0df75659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:55.824473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-5fe14df4-e44b-4d24-8db7-2fb0df75659a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:55.825723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5fe14df4-e44b-4d24-8db7-2fb0df75659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:55.836883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1080/2150] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:55.841219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84d75-83c0-4904-8459-cb2637a47130 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:55.851074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84d75-83c0-4904-8459-cb2637a47130 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:55.855871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f0857-9687-4dc8-8daf-fb747ef010a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:55.856471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f0857-9687-4dc8-8daf-fb747ef010a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:55.856748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f0857-9687-4dc8-8daf-fb747ef010a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:55.857018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f0857-9687-4dc8-8daf-fb747ef010a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:55.857725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f0857-9687-4dc8-8daf-fb747ef010a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:55.858022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f0857-9687-4dc8-8daf-fb747ef010a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:55.859602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f0857-9687-4dc8-8daf-fb747ef010a0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:55.871872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1071/2151] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:26:55.876083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe14df4-e44b-4d24-8db7-2fb0df75659a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:55.886454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe14df4-e44b-4d24-8db7-2fb0df75659a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:55.893869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc9f6-d2fc-4925-a49a-01744e4a8ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:55.894507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc9f6-d2fc-4925-a49a-01744e4a8ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:55.894787 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc9f6-d2fc-4925-a49a-01744e4a8ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:55.895062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc9f6-d2fc-4925-a49a-01744e4a8ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:55.895759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbc9f6-d2fc-4925-a49a-01744e4a8ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:55.897712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbc9f6-d2fc-4925-a49a-01744e4a8ca6 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:55.930089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1081/2152] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:55 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:55.934018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f0857-9687-4dc8-8daf-fb747ef010a0 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:55.945397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f0857-9687-4dc8-8daf-fb747ef010a0 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:55.958993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:55.996576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc9f6-d2fc-4925-a49a-01744e4a8ca6 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:55.998657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c5dbc9f6-d2fc-4925-a49a-01744e4a8ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:56.007764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806f310-60c1-4ead-ab05-d4521d2d00c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:56.008383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806f310-60c1-4ead-ab05-d4521d2d00c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.008693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806f310-60c1-4ead-ab05-d4521d2d00c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.008970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806f310-60c1-4ead-ab05-d4521d2d00c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.009644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806f310-60c1-4ead-ab05-d4521d2d00c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:56.011553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806f310-60c1-4ead-ab05-d4521d2d00c9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:56.034622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1072/2153] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:55 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:26:56.038574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806f310-60c1-4ead-ab05-d4521d2d00c9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:56.048324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806f310-60c1-4ead-ab05-d4521d2d00c9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:56.053654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70398-10b7-40c1-9ceb-973c8c4a761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:56.054200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70398-10b7-40c1-9ceb-973c8c4a761f admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.054482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70398-10b7-40c1-9ceb-973c8c4a761f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.054757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70398-10b7-40c1-9ceb-973c8c4a761f admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.055397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70398-10b7-40c1-9ceb-973c8c4a761f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:56.056990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70398-10b7-40c1-9ceb-973c8c4a761f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:56.068722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1073/2154] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:26:56.069952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc9f6-d2fc-4925-a49a-01744e4a8ca6 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:56.072606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70398-10b7-40c1-9ceb-973c8c4a761f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:56.074819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:56.075460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.075744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.076022 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] PATH_INFO: `/v3/users/520a42995dc7492abdff83c27c5c6919` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.077168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=520a42995dc7492abdff83c27c5c6919)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:56.079384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:56.082381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70398-10b7-40c1-9ceb-973c8c4a761f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:56.087901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7954e-408c-48d2-be89-17aaafab262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:56.088574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7954e-408c-48d2-be89-17aaafab262f admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.088886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7954e-408c-48d2-be89-17aaafab262f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.089181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7954e-408c-48d2-be89-17aaafab262f admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.089825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7954e-408c-48d2-be89-17aaafab262f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:56.091413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7954e-408c-48d2-be89-17aaafab262f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:56.101983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:56.105816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1074/2155] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:26:56.106855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7954e-408c-48d2-be89-17aaafab262f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:56.118571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7954e-408c-48d2-be89-17aaafab262f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:56.123364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8072a-ceab-4cbf-a989-47f67f6f7c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:56.124099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8072a-ceab-4cbf-a989-47f67f6f7c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.124355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8072a-ceab-4cbf-a989-47f67f6f7c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.124570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8072a-ceab-4cbf-a989-47f67f6f7c35 admin admin] PATH_INFO: `/v3/projects/6e35c5f5d9cb46f693ac3d9e8e964b0f/users/03b5d70a9a224887995517fc29771b31/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.130350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520a42995dc7492abdff83c27c5c6919'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:56.140701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520a42995dc7492abdff83c27c5c6919'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:56.141481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520a42995dc7492abdff83c27c5c6919'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:56.143089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8072a-ceab-4cbf-a989-47f67f6f7c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e35c5f5d9cb46f693ac3d9e8e964b0f, user_id=03b5d70a9a224887995517fc29771b31, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:56.145952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8072a-ceab-4cbf-a989-47f67f6f7c35 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:56.157060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520a42995dc7492abdff83c27c5c6919'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:56.173012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1075/2156] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:56 2022] PUT /identity/v3/projects/6e35c5f5d9cb46f693ac3d9e8e964b0f/users/03b5d70a9a224887995517fc29771b31/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:56.173382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-3ea1c93c-24b6-4799-b6a8-933741dfa09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520a42995dc7492abdff83c27c5c6919'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:56.177672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4313f42-38ca-44c1-bc28-cddcbff525e2 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.178065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4313f42-38ca-44c1-bc28-cddcbff525e2 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.178442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4313f42-38ca-44c1-bc28-cddcbff525e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.179248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1082/2157] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:55 2022] DELETE /identity/v3/users/520a42995dc7492abdff83c27c5c6919 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:56.185173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05d8e2-1a50-4c0e-a2eb-58d6957f8ba7 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.185529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05d8e2-1a50-4c0e-a2eb-58d6957f8ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.185971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05d8e2-1a50-4c0e-a2eb-58d6957f8ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.206618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-0d05d8e2-1a50-4c0e-a2eb-58d6957f8ba7 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:56.208099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0d05d8e2-1a50-4c0e-a2eb-58d6957f8ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:56.215406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-e4313f42-38ca-44c1-bc28-cddcbff525e2 None None] MFA Rules not processed for user `03b5d70a9a224887995517fc29771b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:56.217279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e4313f42-38ca-44c1-bc28-cddcbff525e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:56.302761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1083/2158] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:56.314583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05d8e2-1a50-4c0e-a2eb-58d6957f8ba7 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:56.317600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0d05d8e2-1a50-4c0e-a2eb-58d6957f8ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:56.351594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1076/2159] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:56.362747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4313f42-38ca-44c1-bc28-cddcbff525e2 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:56.364606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e4313f42-38ca-44c1-bc28-cddcbff525e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:56.443941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05d8e2-1a50-4c0e-a2eb-58d6957f8ba7 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:56.450530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ecce-4bd3-4893-80b8-2b9ad5657af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:56.451078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ecce-4bd3-4893-80b8-2b9ad5657af1 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.451566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ecce-4bd3-4893-80b8-2b9ad5657af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.451926 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ecce-4bd3-4893-80b8-2b9ad5657af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.468522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ecce-4bd3-4893-80b8-2b9ad5657af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:56.470146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ecce-4bd3-4893-80b8-2b9ad5657af1 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:56.476907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4313f42-38ca-44c1-bc28-cddcbff525e2 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:56.483085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de71c6-ed36-45b8-85d5-f829e983e29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:56.483929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1084/2160] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:56.484088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de71c6-ed36-45b8-85d5-f829e983e29d service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.484310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de71c6-ed36-45b8-85d5-f829e983e29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.484631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de71c6-ed36-45b8-85d5-f829e983e29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.490630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:56.502830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de71c6-ed36-45b8-85d5-f829e983e29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:56.504659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de71c6-ed36-45b8-85d5-f829e983e29d service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:56.522130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1077/2161] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:56.841059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ecce-4bd3-4893-80b8-2b9ad5657af1 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:56.843013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c757ecce-4bd3-4893-80b8-2b9ad5657af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:56.867552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ecce-4bd3-4893-80b8-2b9ad5657af1 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:56.892108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:56.892773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:56.893058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:56.893918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] PATH_INFO: `/v3/projects/ed9b8d4281304d549fc456004841b87c` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:56.895059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9b8d4281304d549fc456004841b87c)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:56.897480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:56.963795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:56.976857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9b8d4281304d549fc456004841b87c', 'request_id': 'req-30877c20-71df-44ed-b627-2b2eea47234a'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:56.984418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9b8d4281304d549fc456004841b87c', 'request_id': 'req-30877c20-71df-44ed-b627-2b2eea47234a'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:56.995935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9b8d4281304d549fc456004841b87c', 'request_id': 'req-30877c20-71df-44ed-b627-2b2eea47234a'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:57.020209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] The token cache is being invalidate because project ed9b8d4281304d549fc456004841b87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:57.021104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:57.021425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-30877c20-71df-44ed-b627-2b2eea47234a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:57.023511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1085/2162] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:56 2022] DELETE /identity/v3/projects/ed9b8d4281304d549fc456004841b87c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:57.538131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de71c6-ed36-45b8-85d5-f829e983e29d service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:57.539569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f0de71c6-ed36-45b8-85d5-f829e983e29d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:57.554520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de71c6-ed36-45b8-85d5-f829e983e29d service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:57.615654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:57.616397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:57.616597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:57.616871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] PATH_INFO: `/v3/users/711c0ca594df41c6ba91590720fdef37` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:57.618068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] RBAC: Authorizing `identity:delete_user(user_id=711c0ca594df41c6ba91590720fdef37)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:57.621465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:57.675069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711c0ca594df41c6ba91590720fdef37'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:57.683472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711c0ca594df41c6ba91590720fdef37'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:57.684286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711c0ca594df41c6ba91590720fdef37'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:57.697072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711c0ca594df41c6ba91590720fdef37'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:57.704191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711c0ca594df41c6ba91590720fdef37'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:57.710210 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1078/2163] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:57 2022] DELETE /identity/v3/users/711c0ca594df41c6ba91590720fdef37 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:57.715006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717c99d-38f2-4e6e-960f-2739480ade15 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:57.715301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717c99d-38f2-4e6e-960f-2739480ade15 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:57.715579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717c99d-38f2-4e6e-960f-2739480ade15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:57.735726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-9717c99d-38f2-4e6e-960f-2739480ade15 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:57.737655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9717c99d-38f2-4e6e-960f-2739480ade15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:57.795759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1086/2164] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:57.807101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:57.808998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:57.866381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499759d7-f2c9-4521-85a6-affe5798116d admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:57.869931 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24497cd-135e-4679-970e-504b71de51a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:57.870530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24497cd-135e-4679-970e-504b71de51a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:57.870827 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24497cd-135e-4679-970e-504b71de51a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:57.871229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24497cd-135e-4679-970e-504b71de51a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:57.880331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24497cd-135e-4679-970e-504b71de51a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:57.881849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24497cd-135e-4679-970e-504b71de51a3 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:57.891257 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1079/2165] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:26:58.171136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717c99d-38f2-4e6e-960f-2739480ade15 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:58.172607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9717c99d-38f2-4e6e-960f-2739480ade15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:58.191939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717c99d-38f2-4e6e-960f-2739480ade15 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:58.204445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:58.205091 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:58.205403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:58.206224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] PATH_INFO: `/v3/projects/7ab8b41297aa44ecb60b25c06338a6a8` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:58.207339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab8b41297aa44ecb60b25c06338a6a8)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:58.209257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:58.257498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab8b41297aa44ecb60b25c06338a6a8', 'request_id': 'req-afe77944-1665-4c7d-aebf-760a6c920e83'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.263836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab8b41297aa44ecb60b25c06338a6a8', 'request_id': 'req-afe77944-1665-4c7d-aebf-760a6c920e83'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.270278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab8b41297aa44ecb60b25c06338a6a8', 'request_id': 'req-afe77944-1665-4c7d-aebf-760a6c920e83'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.282895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] The token cache is being invalidate because project 7ab8b41297aa44ecb60b25c06338a6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:58.283191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.284439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.286084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1087/2166] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:58 2022] DELETE /identity/v3/projects/7ab8b41297aa44ecb60b25c06338a6a8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:58.290139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24497cd-135e-4679-970e-504b71de51a3 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:58.300579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24497cd-135e-4679-970e-504b71de51a3 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:58.312643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:58.362926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:58.363574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:58.363860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:58.364143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] PATH_INFO: `/v3/users/4d0460e746f34786a49babd75117d665` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:58.365298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0460e746f34786a49babd75117d665)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:58.367286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:58.421146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0460e746f34786a49babd75117d665'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.428603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0460e746f34786a49babd75117d665'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.429263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0460e746f34786a49babd75117d665'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.442016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0460e746f34786a49babd75117d665'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.449601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f7e5c05b-bbdc-4ca1-87de-880e4ddcdf1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0460e746f34786a49babd75117d665'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:58.456618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1080/2167] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:26:58 2022] DELETE /identity/v3/users/4d0460e746f34786a49babd75117d665 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:59.020972 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:59.022564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:59.037708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe77944-1665-4c7d-aebf-760a6c920e83 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:59.101608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:59.121157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:59.121954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.122238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.122512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] PATH_INFO: `/v3/projects/893d44cef9a74205b7eaac6edfeec1ce` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.123670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] RBAC: Authorizing `identity:delete_project(project_id=893d44cef9a74205b7eaac6edfeec1ce)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:59.125636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:59.181015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893d44cef9a74205b7eaac6edfeec1ce', 'request_id': 'req-938e724b-0d86-440e-b8f9-5a6c6be2391b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:59.188268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893d44cef9a74205b7eaac6edfeec1ce', 'request_id': 'req-938e724b-0d86-440e-b8f9-5a6c6be2391b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:59.195569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893d44cef9a74205b7eaac6edfeec1ce', 'request_id': 'req-938e724b-0d86-440e-b8f9-5a6c6be2391b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:59.211416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] The token cache is being invalidate because project 893d44cef9a74205b7eaac6edfeec1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:26:59.211826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:59.212543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-938e724b-0d86-440e-b8f9-5a6c6be2391b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:26:59.214389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1088/2168] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:26:59 2022] DELETE /identity/v3/projects/893d44cef9a74205b7eaac6edfeec1ce => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:26:59.219319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5a4c-48e0-477e-b109-c688e47054b2 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.219847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5a4c-48e0-477e-b109-c688e47054b2 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.219958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5a4c-48e0-477e-b109-c688e47054b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.240071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-00aa5a4c-48e0-477e-b109-c688e47054b2 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:59.241404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-00aa5a4c-48e0-477e-b109-c688e47054b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:59.316082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1081/2169] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:59.324591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03305fe-6152-4912-b812-d5582b74e0e5 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.324893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03305fe-6152-4912-b812-d5582b74e0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.325176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03305fe-6152-4912-b812-d5582b74e0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.348224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d03305fe-6152-4912-b812-d5582b74e0e5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:59.349615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d03305fe-6152-4912-b812-d5582b74e0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:59.361058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1089/2170] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:26:59.365770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5a4c-48e0-477e-b109-c688e47054b2 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:59.387718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5a4c-48e0-477e-b109-c688e47054b2 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:59.394867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de15d-6c6a-4c94-893b-ef87e05b663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:59.395654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de15d-6c6a-4c94-893b-ef87e05b663c admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.396007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de15d-6c6a-4c94-893b-ef87e05b663c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.396364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de15d-6c6a-4c94-893b-ef87e05b663c admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.397079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de15d-6c6a-4c94-893b-ef87e05b663c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:26:59.397515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de15d-6c6a-4c94-893b-ef87e05b663c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:59.399189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de15d-6c6a-4c94-893b-ef87e05b663c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:59.417467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1082/2171] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:26:59.418926 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03305fe-6152-4912-b812-d5582b74e0e5 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:59.430934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03305fe-6152-4912-b812-d5582b74e0e5 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:59.450537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836db58-6f7d-46e5-9397-9ccd7893cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:59.450708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836db58-6f7d-46e5-9397-9ccd7893cd44 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.450893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836db58-6f7d-46e5-9397-9ccd7893cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.451317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836db58-6f7d-46e5-9397-9ccd7893cd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.452015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836db58-6f7d-46e5-9397-9ccd7893cd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:59.453991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836db58-6f7d-46e5-9397-9ccd7893cd44 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:59.505271 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1090/2172] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:26:59 2022] POST /identity/v3/projects => generated 361 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:59.509425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de15d-6c6a-4c94-893b-ef87e05b663c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:59.520675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de15d-6c6a-4c94-893b-ef87e05b663c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:59.542522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:59.589142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0a40a-08f1-4ee2-9d5a-9769fd6c25fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:59.589865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0a40a-08f1-4ee2-9d5a-9769fd6c25fa admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.590221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0a40a-08f1-4ee2-9d5a-9769fd6c25fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.590570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0a40a-08f1-4ee2-9d5a-9769fd6c25fa admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.591579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0a40a-08f1-4ee2-9d5a-9769fd6c25fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:59.594695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0a40a-08f1-4ee2-9d5a-9769fd6c25fa admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:59.619468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1083/2173] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:26:59 2022] POST /identity/v3/users => generated 281 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:26:59.623780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836db58-6f7d-46e5-9397-9ccd7893cd44 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:59.628424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0a40a-08f1-4ee2-9d5a-9769fd6c25fa admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:59.630135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6cc0a40a-08f1-4ee2-9d5a-9769fd6c25fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:59.635152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836db58-6f7d-46e5-9397-9ccd7893cd44 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:59.640126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da82d7e-dff6-4eb1-b176-851a59256400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:59.640928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da82d7e-dff6-4eb1-b176-851a59256400 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.641212 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da82d7e-dff6-4eb1-b176-851a59256400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.641518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da82d7e-dff6-4eb1-b176-851a59256400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.642169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da82d7e-dff6-4eb1-b176-851a59256400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:59.643821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da82d7e-dff6-4eb1-b176-851a59256400 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:59.654208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1091/2174] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:26:59.658985 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da82d7e-dff6-4eb1-b176-851a59256400 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:59.672514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da82d7e-dff6-4eb1-b176-851a59256400 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:59.678381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b9d54-2fbf-4b10-8259-e65320fa9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:59.679625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b9d54-2fbf-4b10-8259-e65320fa9976 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.679625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b9d54-2fbf-4b10-8259-e65320fa9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.679817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b9d54-2fbf-4b10-8259-e65320fa9976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.680588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b9d54-2fbf-4b10-8259-e65320fa9976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:59.682556 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b9d54-2fbf-4b10-8259-e65320fa9976 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:59.694773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1092/2175] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:26:59.699057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b9d54-2fbf-4b10-8259-e65320fa9976 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:59.702936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0a40a-08f1-4ee2-9d5a-9769fd6c25fa admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:59.706751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:59.707319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.707600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.707876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.708966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b9d54-2fbf-4b10-8259-e65320fa9976 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:59.709817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:59.713885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57a050-c87d-4dd3-b926-1b469b1331c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:59.714533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57a050-c87d-4dd3-b926-1b469b1331c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.714814 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57a050-c87d-4dd3-b926-1b469b1331c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.715090 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57a050-c87d-4dd3-b926-1b469b1331c1 admin admin] PATH_INFO: `/v3/projects/96412fdaef68490aac7d2e26eb17a976/users/8fc99218e2674588bcd04e9679ea90c9/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.731471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57a050-c87d-4dd3-b926-1b469b1331c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96412fdaef68490aac7d2e26eb17a976, user_id=8fc99218e2674588bcd04e9679ea90c9, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:59.733901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57a050-c87d-4dd3-b926-1b469b1331c1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:59.748335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1093/2176] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:26:59 2022] PUT /identity/v3/projects/96412fdaef68490aac7d2e26eb17a976/users/8fc99218e2674588bcd04e9679ea90c9/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:26:59.759998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4ff0-9c2b-455e-89b8-279ecfe030ff None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.760290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4ff0-9c2b-455e-89b8-279ecfe030ff None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.760563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4ff0-9c2b-455e-89b8-279ecfe030ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.778938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:59.780445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:59.788568 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-9c5d4ff0-9c2b-455e-89b8-279ecfe030ff None None] MFA Rules not processed for user `8fc99218e2674588bcd04e9679ea90c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:26:59.789816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9c5d4ff0-9c2b-455e-89b8-279ecfe030ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:59.790484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1084/2177] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:26:59.845460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:26:59.865998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1094/2178] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:26:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:26:59.903395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:26:59.904998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:26:59.916138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7fd9-92ce-45c1-aac6-f0197e8e360f service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:26:59.970832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2de4a9-c0be-4540-85e6-8d4ccba3a946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:26:59.971486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de4a9-c0be-4540-85e6-8d4ccba3a946 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:26:59.971771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de4a9-c0be-4540-85e6-8d4ccba3a946 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:26:59.972050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de4a9-c0be-4540-85e6-8d4ccba3a946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:26:59.981132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2de4a9-c0be-4540-85e6-8d4ccba3a946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:26:59.982721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2de4a9-c0be-4540-85e6-8d4ccba3a946 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:26:59.991762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1085/2179] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:26:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:00.008083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d4ff0-9c2b-455e-89b8-279ecfe030ff None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:00.072048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d4ff0-9c2b-455e-89b8-279ecfe030ff None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:00.076592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:00.077226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:00.077545 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:00.077824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] PATH_INFO: `/v3/users/8fc99218e2674588bcd04e9679ea90c9` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:00.078990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc99218e2674588bcd04e9679ea90c9)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:00.081651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:00.133206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc99218e2674588bcd04e9679ea90c9'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.145270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc99218e2674588bcd04e9679ea90c9'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.145270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc99218e2674588bcd04e9679ea90c9'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.162467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc99218e2674588bcd04e9679ea90c9'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.171094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc99218e2674588bcd04e9679ea90c9'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.178526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1095/2180] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:00 2022] DELETE /identity/v3/users/8fc99218e2674588bcd04e9679ea90c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:00.183110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dba638-e5fa-4b7f-b7ec-cc5a08e2680f None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:00.183403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dba638-e5fa-4b7f-b7ec-cc5a08e2680f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:00.183682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dba638-e5fa-4b7f-b7ec-cc5a08e2680f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:00.194989 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:00.209408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-53dba638-e5fa-4b7f-b7ec-cc5a08e2680f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:00.211720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-53dba638-e5fa-4b7f-b7ec-cc5a08e2680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:00.283070 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1086/2181] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:00.289708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:00.291518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:00.351753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52084ffc-9f35-4b54-ad65-73af39a63a49 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:00.355632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fd9e4-fe42-4ca5-bba4-18684bc7d28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:00.356243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd9e4-fe42-4ca5-bba4-18684bc7d28c service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:00.356520 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd9e4-fe42-4ca5-bba4-18684bc7d28c service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:00.356789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd9e4-fe42-4ca5-bba4-18684bc7d28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:00.366343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fd9e4-fe42-4ca5-bba4-18684bc7d28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:00.367848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fd9e4-fe42-4ca5-bba4-18684bc7d28c service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:00.379500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1096/2182] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:00.666365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dba638-e5fa-4b7f-b7ec-cc5a08e2680f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:00.668331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-53dba638-e5fa-4b7f-b7ec-cc5a08e2680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:00.682794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dba638-e5fa-4b7f-b7ec-cc5a08e2680f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:00.687806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:00.688460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:00.689045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:00.689045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] PATH_INFO: `/v3/projects/96412fdaef68490aac7d2e26eb17a976` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:00.690706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] RBAC: Authorizing `identity:delete_project(project_id=96412fdaef68490aac7d2e26eb17a976)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:00.693514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:00.746274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96412fdaef68490aac7d2e26eb17a976', 'request_id': 'req-e9d0da46-cb80-41b5-9982-d71f1e14369b'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.755818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96412fdaef68490aac7d2e26eb17a976', 'request_id': 'req-e9d0da46-cb80-41b5-9982-d71f1e14369b'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.764474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96412fdaef68490aac7d2e26eb17a976', 'request_id': 'req-e9d0da46-cb80-41b5-9982-d71f1e14369b'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.780099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] The token cache is being invalidate because project 96412fdaef68490aac7d2e26eb17a976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:00.780421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.781329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e9d0da46-cb80-41b5-9982-d71f1e14369b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:00.783167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1087/2183] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:00 2022] DELETE /identity/v3/projects/96412fdaef68490aac7d2e26eb17a976 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:00.789455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b587e14-b370-4b29-b19e-071f7ba4d50a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:00.789919 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b587e14-b370-4b29-b19e-071f7ba4d50a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:00.790283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b587e14-b370-4b29-b19e-071f7ba4d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:00.814998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6b587e14-b370-4b29-b19e-071f7ba4d50a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:00.816234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6b587e14-b370-4b29-b19e-071f7ba4d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:00.830579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:00.888759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1097/2184] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:00.896749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89299926-72ca-42f5-86a6-43a9f053e225 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:00.897046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89299926-72ca-42f5-86a6-43a9f053e225 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:00.897365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89299926-72ca-42f5-86a6-43a9f053e225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:00.918821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-89299926-72ca-42f5-86a6-43a9f053e225 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:00.920041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-89299926-72ca-42f5-86a6-43a9f053e225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:00.929744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1088/2185] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:00.934245 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b587e14-b370-4b29-b19e-071f7ba4d50a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:00.946625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b587e14-b370-4b29-b19e-071f7ba4d50a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:00.952169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4ebe1-9d84-4367-b81b-e99915917bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:00.953016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ebe1-9d84-4367-b81b-e99915917bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:00.953439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ebe1-9d84-4367-b81b-e99915917bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:00.953717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ebe1-9d84-4367-b81b-e99915917bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:00.954586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4ebe1-9d84-4367-b81b-e99915917bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:00.954895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4ebe1-9d84-4367-b81b-e99915917bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:00.957087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4ebe1-9d84-4367-b81b-e99915917bd9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:00.976044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1098/2186] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:27:00.980918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89299926-72ca-42f5-86a6-43a9f053e225 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:00.991207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89299926-72ca-42f5-86a6-43a9f053e225 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:00.996174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24c071-fc08-47e7-8898-151a67b45ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:00.996842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c071-fc08-47e7-8898-151a67b45ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:00.997127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c071-fc08-47e7-8898-151a67b45ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:00.997432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c071-fc08-47e7-8898-151a67b45ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:00.998134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24c071-fc08-47e7-8898-151a67b45ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.000283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24c071-fc08-47e7-8898-151a67b45ac6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.029901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1089/2187] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:00 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:01.034591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4ebe1-9d84-4367-b81b-e99915917bd9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.044578 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4ebe1-9d84-4367-b81b-e99915917bd9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.103171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9000-6775-485d-b0bc-fca079c70950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.103793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9000-6775-485d-b0bc-fca079c70950 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.104078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9000-6775-485d-b0bc-fca079c70950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.104609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9000-6775-485d-b0bc-fca079c70950 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.105284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c9000-6775-485d-b0bc-fca079c70950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.107239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c9000-6775-485d-b0bc-fca079c70950 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.133779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1099/2188] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:01 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:01.139212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24c071-fc08-47e7-8898-151a67b45ac6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.151169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24c071-fc08-47e7-8898-151a67b45ac6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.156076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6feaa3-ac49-43ab-a559-8ff868a3afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.156941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6feaa3-ac49-43ab-a559-8ff868a3afce admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.157341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6feaa3-ac49-43ab-a559-8ff868a3afce admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.157618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6feaa3-ac49-43ab-a559-8ff868a3afce admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.158258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6feaa3-ac49-43ab-a559-8ff868a3afce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.160822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6feaa3-ac49-43ab-a559-8ff868a3afce admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.171764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1090/2189] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:01.176603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9000-6775-485d-b0bc-fca079c70950 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.187128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9000-6775-485d-b0bc-fca079c70950 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.191849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9bae1-15a3-42b9-9419-de74bd2f1b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.192449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9bae1-15a3-42b9-9419-de74bd2f1b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.192753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9bae1-15a3-42b9-9419-de74bd2f1b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.193025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9bae1-15a3-42b9-9419-de74bd2f1b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.193701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9bae1-15a3-42b9-9419-de74bd2f1b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.195290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9bae1-15a3-42b9-9419-de74bd2f1b81 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.206542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1100/2190] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:01.211061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6feaa3-ac49-43ab-a559-8ff868a3afce admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.222006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6feaa3-ac49-43ab-a559-8ff868a3afce admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.226694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f75a9-4219-4513-abe3-efdb9f0a5c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.227351 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f75a9-4219-4513-abe3-efdb9f0a5c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.227633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f75a9-4219-4513-abe3-efdb9f0a5c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.227938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f75a9-4219-4513-abe3-efdb9f0a5c68 admin admin] PATH_INFO: `/v3/projects/6a136bd3c06a49c8be9439ecfe4fcf89/users/a3abce51d78645e581a0d9b16cbf7f48/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.244215 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f75a9-4219-4513-abe3-efdb9f0a5c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a136bd3c06a49c8be9439ecfe4fcf89, user_id=a3abce51d78645e581a0d9b16cbf7f48, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.247085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f75a9-4219-4513-abe3-efdb9f0a5c68 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.260056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1091/2191] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:01 2022] PUT /identity/v3/projects/6a136bd3c06a49c8be9439ecfe4fcf89/users/a3abce51d78645e581a0d9b16cbf7f48/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:01.270857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e7356-14c7-4f03-9b55-41bc5d5eb21b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.271144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e7356-14c7-4f03-9b55-41bc5d5eb21b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.271419 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e7356-14c7-4f03-9b55-41bc5d5eb21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.299319 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-5e4e7356-14c7-4f03-9b55-41bc5d5eb21b None None] MFA Rules not processed for user `a3abce51d78645e581a0d9b16cbf7f48`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:01.300523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5e4e7356-14c7-4f03-9b55-41bc5d5eb21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:01.373355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1101/2192] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:01.382352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f75a9-4219-4513-abe3-efdb9f0a5c68 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.410631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:01.450241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f75a9-4219-4513-abe3-efdb9f0a5c68 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.455097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85626a16-ab5d-4225-9bf9-cf5e4935b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.456332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85626a16-ab5d-4225-9bf9-cf5e4935b570 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.456646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85626a16-ab5d-4225-9bf9-cf5e4935b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.456947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85626a16-ab5d-4225-9bf9-cf5e4935b570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.457616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85626a16-ab5d-4225-9bf9-cf5e4935b570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.459516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85626a16-ab5d-4225-9bf9-cf5e4935b570 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.485725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1092/2193] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:01 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:01.489863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e7356-14c7-4f03-9b55-41bc5d5eb21b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.501204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e7356-14c7-4f03-9b55-41bc5d5eb21b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.506545 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:01.560940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b313b8c-92ef-469c-8206-78464c04af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.561265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b313b8c-92ef-469c-8206-78464c04af29 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.561549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b313b8c-92ef-469c-8206-78464c04af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.561866 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b313b8c-92ef-469c-8206-78464c04af29 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.562477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b313b8c-92ef-469c-8206-78464c04af29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.564427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b313b8c-92ef-469c-8206-78464c04af29 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.588350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1102/2194] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:01 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:01.592506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85626a16-ab5d-4225-9bf9-cf5e4935b570 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.603442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85626a16-ab5d-4225-9bf9-cf5e4935b570 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.608428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee7c3-6f37-49ab-9f81-d568fb6e26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.609058 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee7c3-6f37-49ab-9f81-d568fb6e26d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.609385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee7c3-6f37-49ab-9f81-d568fb6e26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.609665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee7c3-6f37-49ab-9f81-d568fb6e26d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.610317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ee7c3-6f37-49ab-9f81-d568fb6e26d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.611953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ee7c3-6f37-49ab-9f81-d568fb6e26d5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.623148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1093/2195] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:01.630176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b313b8c-92ef-469c-8206-78464c04af29 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.641798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b313b8c-92ef-469c-8206-78464c04af29 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.647855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56346b0e-576c-42bd-b33a-7c0748649c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.648726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56346b0e-576c-42bd-b33a-7c0748649c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.649080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56346b0e-576c-42bd-b33a-7c0748649c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.649459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56346b0e-576c-42bd-b33a-7c0748649c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.650193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56346b0e-576c-42bd-b33a-7c0748649c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.651921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56346b0e-576c-42bd-b33a-7c0748649c1a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.666198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1103/2196] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:01.667400 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee7c3-6f37-49ab-9f81-d568fb6e26d5 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.678496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee7c3-6f37-49ab-9f81-d568fb6e26d5 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.685179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa7fc5-e893-475c-aed5-c2522426ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.685899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa7fc5-e893-475c-aed5-c2522426ffda admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.686196 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa7fc5-e893-475c-aed5-c2522426ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.686450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa7fc5-e893-475c-aed5-c2522426ffda admin admin] PATH_INFO: `/v3/projects/3cd40e64f26c45b6b084407160f5c035/users/2b0709b0e0334ee98bb36b11bd0109e7/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.703742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa7fc5-e893-475c-aed5-c2522426ffda admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd40e64f26c45b6b084407160f5c035, user_id=2b0709b0e0334ee98bb36b11bd0109e7, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:01.707084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa7fc5-e893-475c-aed5-c2522426ffda admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:01.723987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1094/2197] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:01 2022] PUT /identity/v3/projects/3cd40e64f26c45b6b084407160f5c035/users/2b0709b0e0334ee98bb36b11bd0109e7/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:01.796243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d9a2c-67fc-4cc5-be27-228cbfd001bd None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:01.796559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d9a2c-67fc-4cc5-be27-228cbfd001bd None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:01.796828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d9a2c-67fc-4cc5-be27-228cbfd001bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:01.835909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-312d9a2c-67fc-4cc5-be27-228cbfd001bd None None] MFA Rules not processed for user `2b0709b0e0334ee98bb36b11bd0109e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:01.837148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-312d9a2c-67fc-4cc5-be27-228cbfd001bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:01.908887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1104/2198] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:01.913841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa7fc5-e893-475c-aed5-c2522426ffda admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:01.993611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa7fc5-e893-475c-aed5-c2522426ffda admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:01.999346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca510200-1fc5-4b6c-9c33-faf55ce98c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:01.999973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca510200-1fc5-4b6c-9c33-faf55ce98c1d admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:02.000261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca510200-1fc5-4b6c-9c33-faf55ce98c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:02.000541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca510200-1fc5-4b6c-9c33-faf55ce98c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:02.001269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca510200-1fc5-4b6c-9c33-faf55ce98c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:02.003925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca510200-1fc5-4b6c-9c33-faf55ce98c1d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:02.032115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1095/2199] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:01 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:02.036574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d9a2c-67fc-4cc5-be27-228cbfd001bd None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:02.047846 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d9a2c-67fc-4cc5-be27-228cbfd001bd None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:02.111250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297c08e-039e-4930-abe7-0487a8295c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:02.112492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c08e-039e-4930-abe7-0487a8295c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:02.112778 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c08e-039e-4930-abe7-0487a8295c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:02.113055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c08e-039e-4930-abe7-0487a8295c00 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:02.113794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297c08e-039e-4930-abe7-0487a8295c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:02.115841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297c08e-039e-4930-abe7-0487a8295c00 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:02.138633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1105/2200] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:02 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:02.142575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca510200-1fc5-4b6c-9c33-faf55ce98c1d admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:02.153460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca510200-1fc5-4b6c-9c33-faf55ce98c1d admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:02.159635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a8ca4-6194-4991-9291-c0dbf8133c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:02.160422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a8ca4-6194-4991-9291-c0dbf8133c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:02.160694 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a8ca4-6194-4991-9291-c0dbf8133c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:02.161054 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a8ca4-6194-4991-9291-c0dbf8133c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:02.161796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a8ca4-6194-4991-9291-c0dbf8133c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:02.163755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a8ca4-6194-4991-9291-c0dbf8133c36 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:02.175357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1096/2201] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:02.179692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297c08e-039e-4930-abe7-0487a8295c00 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:02.190050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297c08e-039e-4930-abe7-0487a8295c00 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:02.194990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e0794-66da-4cfe-84ba-c4ada13b6d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:02.195655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e0794-66da-4cfe-84ba-c4ada13b6d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:02.195938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e0794-66da-4cfe-84ba-c4ada13b6d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:02.196213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e0794-66da-4cfe-84ba-c4ada13b6d27 admin admin] PATH_INFO: `/v3/projects/39b0ea2d13d8419c8ad51ec69a964c58/users/7d6f02b7443e4b66a845c26701df37fc/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:02.198467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:02.213139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e0794-66da-4cfe-84ba-c4ada13b6d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b0ea2d13d8419c8ad51ec69a964c58, user_id=7d6f02b7443e4b66a845c26701df37fc, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:02.215821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e0794-66da-4cfe-84ba-c4ada13b6d27 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:02.229875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1106/2202] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:02 2022] PUT /identity/v3/projects/39b0ea2d13d8419c8ad51ec69a964c58/users/7d6f02b7443e4b66a845c26701df37fc/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:02.233892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a8ca4-6194-4991-9291-c0dbf8133c36 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:02.244394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a8ca4-6194-4991-9291-c0dbf8133c36 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:02.288450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:02.302030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4dbd9-c355-4b42-963a-be4866b23d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:02.302646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4dbd9-c355-4b42-963a-be4866b23d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:02.302926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4dbd9-c355-4b42-963a-be4866b23d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:02.303200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4dbd9-c355-4b42-963a-be4866b23d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:02.303838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4dbd9-c355-4b42-963a-be4866b23d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:02.305469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4dbd9-c355-4b42-963a-be4866b23d79 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:02.315128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1097/2203] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:02.319321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e0794-66da-4cfe-84ba-c4ada13b6d27 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:02.330751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e0794-66da-4cfe-84ba-c4ada13b6d27 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:02.335790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766798a1-d019-44b3-8dde-119c912cf361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:02.336482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766798a1-d019-44b3-8dde-119c912cf361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:02.336765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766798a1-d019-44b3-8dde-119c912cf361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:02.337042 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766798a1-d019-44b3-8dde-119c912cf361 admin admin] PATH_INFO: `/v3/projects/39b0ea2d13d8419c8ad51ec69a964c58/users/7d6f02b7443e4b66a845c26701df37fc/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:02.339034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766798a1-d019-44b3-8dde-119c912cf361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b0ea2d13d8419c8ad51ec69a964c58, user_id=7d6f02b7443e4b66a845c26701df37fc, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:02.341702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766798a1-d019-44b3-8dde-119c912cf361 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:02.352421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1107/2204] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:02 2022] PUT /identity/v3/projects/39b0ea2d13d8419c8ad51ec69a964c58/users/7d6f02b7443e4b66a845c26701df37fc/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:02.363628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91d09b-8486-48e2-9bd2-fe76575edb9e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:02.364040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91d09b-8486-48e2-9bd2-fe76575edb9e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:02.364316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91d09b-8486-48e2-9bd2-fe76575edb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:02.392000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-ec91d09b-8486-48e2-9bd2-fe76575edb9e None None] MFA Rules not processed for user `7d6f02b7443e4b66a845c26701df37fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:02.393230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ec91d09b-8486-48e2-9bd2-fe76575edb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:02.466105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1098/2205] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:02.478640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766798a1-d019-44b3-8dde-119c912cf361 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:02.480713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-766798a1-d019-44b3-8dde-119c912cf361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:02.547979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766798a1-d019-44b3-8dde-119c912cf361 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:02.551762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b16aa-f2ba-4811-b949-dda40b66314e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:02.552376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b16aa-f2ba-4811-b949-dda40b66314e service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:02.552661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b16aa-f2ba-4811-b949-dda40b66314e service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:02.552933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b16aa-f2ba-4811-b949-dda40b66314e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:02.616317 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b16aa-f2ba-4811-b949-dda40b66314e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:02.617813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b16aa-f2ba-4811-b949-dda40b66314e service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:02.626800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1108/2206] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:04.210091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91d09b-8486-48e2-9bd2-fe76575edb9e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:04.211531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ec91d09b-8486-48e2-9bd2-fe76575edb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:04.224076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91d09b-8486-48e2-9bd2-fe76575edb9e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:04.227904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d6c6a-cf07-4fdd-95af-52a8d2d8eb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:04.228558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d6c6a-cf07-4fdd-95af-52a8d2d8eb56 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:04.228842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d6c6a-cf07-4fdd-95af-52a8d2d8eb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:04.229114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d6c6a-cf07-4fdd-95af-52a8d2d8eb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:04.291347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d6c6a-cf07-4fdd-95af-52a8d2d8eb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:04.293015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d6c6a-cf07-4fdd-95af-52a8d2d8eb56 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:04.305277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1099/2207] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:04.978290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b16aa-f2ba-4811-b949-dda40b66314e service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:04.988196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b16aa-f2ba-4811-b949-dda40b66314e service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:04.992535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a04a4-75e8-422a-82ca-2716199881e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:04.993313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a04a4-75e8-422a-82ca-2716199881e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:04.993605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a04a4-75e8-422a-82ca-2716199881e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:04.993881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a04a4-75e8-422a-82ca-2716199881e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:05.010270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a04a4-75e8-422a-82ca-2716199881e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:05.011936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a04a4-75e8-422a-82ca-2716199881e6 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:05.022180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1109/2208] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:27:07.551213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d6c6a-cf07-4fdd-95af-52a8d2d8eb56 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:07.552690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-248d6c6a-cf07-4fdd-95af-52a8d2d8eb56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:07.627621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d6c6a-cf07-4fdd-95af-52a8d2d8eb56 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:07.632208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:07.632865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:07.633179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:07.633552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] PATH_INFO: `/v3/users/03b5d70a9a224887995517fc29771b31` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:07.634765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b5d70a9a224887995517fc29771b31)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:07.636783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:07.648353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:07.694076 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b5d70a9a224887995517fc29771b31'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:07.701836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b5d70a9a224887995517fc29771b31'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:07.702467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b5d70a9a224887995517fc29771b31'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:07.716098 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b5d70a9a224887995517fc29771b31'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:07.725455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b5d70a9a224887995517fc29771b31'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:07.734391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1100/2209] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:07 2022] DELETE /identity/v3/users/03b5d70a9a224887995517fc29771b31 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:07.739626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811f7c0-9d86-475d-a030-1a3f87057621 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:07.740152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811f7c0-9d86-475d-a030-1a3f87057621 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:07.740238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811f7c0-9d86-475d-a030-1a3f87057621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:07.763736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-7811f7c0-9d86-475d-a030-1a3f87057621 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:07.765097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7811f7c0-9d86-475d-a030-1a3f87057621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:07.828361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1110/2210] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:07.838566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:07.839976 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:07.910649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a12aaa-712f-4aeb-bdf6-87824385efad admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:07.914348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2fc81-9840-468b-b698-ef7de37f3d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:07.914974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2fc81-9840-468b-b698-ef7de37f3d52 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:07.915258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2fc81-9840-468b-b698-ef7de37f3d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:07.915553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2fc81-9840-468b-b698-ef7de37f3d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:07.926095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2fc81-9840-468b-b698-ef7de37f3d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:07.927607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2fc81-9840-468b-b698-ef7de37f3d52 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:07.937837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1101/2211] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:08.211425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811f7c0-9d86-475d-a030-1a3f87057621 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:08.213212 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7811f7c0-9d86-475d-a030-1a3f87057621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:08.228127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811f7c0-9d86-475d-a030-1a3f87057621 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:08.233180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:08.233881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.234161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.234613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] PATH_INFO: `/v3/projects/6e35c5f5d9cb46f693ac3d9e8e964b0f` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.235755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e35c5f5d9cb46f693ac3d9e8e964b0f)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:08.237716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:08.244825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:08.302914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e35c5f5d9cb46f693ac3d9e8e964b0f', 'request_id': 'req-1e78590f-bc59-444d-ade2-2d461742e7e5'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:08.309394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e35c5f5d9cb46f693ac3d9e8e964b0f', 'request_id': 'req-1e78590f-bc59-444d-ade2-2d461742e7e5'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:08.316069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e35c5f5d9cb46f693ac3d9e8e964b0f', 'request_id': 'req-1e78590f-bc59-444d-ade2-2d461742e7e5'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:08.328506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] The token cache is being invalidate because project 6e35c5f5d9cb46f693ac3d9e8e964b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:08.328796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:08.329468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1e78590f-bc59-444d-ade2-2d461742e7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:08.331625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1111/2212] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:08 2022] DELETE /identity/v3/projects/6e35c5f5d9cb46f693ac3d9e8e964b0f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:08.336841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86abb1f-09ef-45e2-bb7f-436ff28b46bf None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.337125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86abb1f-09ef-45e2-bb7f-436ff28b46bf None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.337441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86abb1f-09ef-45e2-bb7f-436ff28b46bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.359690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f86abb1f-09ef-45e2-bb7f-436ff28b46bf None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:08.360892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f86abb1f-09ef-45e2-bb7f-436ff28b46bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:08.429944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1102/2213] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:08.439243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495873d-4102-48b6-8004-ec5212f68b50 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.439640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495873d-4102-48b6-8004-ec5212f68b50 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.440416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495873d-4102-48b6-8004-ec5212f68b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.462653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2495873d-4102-48b6-8004-ec5212f68b50 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:08.463879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2495873d-4102-48b6-8004-ec5212f68b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:08.472595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1112/2214] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:08.477882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86abb1f-09ef-45e2-bb7f-436ff28b46bf None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:08.490828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86abb1f-09ef-45e2-bb7f-436ff28b46bf None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:08.495922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f367ea-03ca-4fd6-bc27-46ef5cdd7756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:08.496633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f367ea-03ca-4fd6-bc27-46ef5cdd7756 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.496983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f367ea-03ca-4fd6-bc27-46ef5cdd7756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.497352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f367ea-03ca-4fd6-bc27-46ef5cdd7756 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.498066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f367ea-03ca-4fd6-bc27-46ef5cdd7756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:08.498437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f367ea-03ca-4fd6-bc27-46ef5cdd7756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:08.500366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f367ea-03ca-4fd6-bc27-46ef5cdd7756 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:08.513275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1103/2215] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:27:08.517269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495873d-4102-48b6-8004-ec5212f68b50 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:08.527505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495873d-4102-48b6-8004-ec5212f68b50 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:08.533214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ebe71-5f5a-4e23-95f1-85b1e3004029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:08.533918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ebe71-5f5a-4e23-95f1-85b1e3004029 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.534210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ebe71-5f5a-4e23-95f1-85b1e3004029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.534485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ebe71-5f5a-4e23-95f1-85b1e3004029 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.535142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ebe71-5f5a-4e23-95f1-85b1e3004029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:08.537207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ebe71-5f5a-4e23-95f1-85b1e3004029 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:08.577379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1113/2216] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:08 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:08.581503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f367ea-03ca-4fd6-bc27-46ef5cdd7756 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:08.595644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f367ea-03ca-4fd6-bc27-46ef5cdd7756 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:08.618462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:08.676745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691efc1e-695f-478e-add4-e923be25f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:08.677653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691efc1e-695f-478e-add4-e923be25f360 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.677938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691efc1e-695f-478e-add4-e923be25f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.678211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691efc1e-695f-478e-add4-e923be25f360 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.679894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691efc1e-695f-478e-add4-e923be25f360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:08.681844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691efc1e-695f-478e-add4-e923be25f360 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:08.703875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1104/2217] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:08 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:08.708669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ebe71-5f5a-4e23-95f1-85b1e3004029 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:08.719273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ebe71-5f5a-4e23-95f1-85b1e3004029 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:08.724236 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4625d-011b-444f-9813-60b037ee151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:08.724911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4625d-011b-444f-9813-60b037ee151d admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.725220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4625d-011b-444f-9813-60b037ee151d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.725530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4625d-011b-444f-9813-60b037ee151d admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.726188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4625d-011b-444f-9813-60b037ee151d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:08.727801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4625d-011b-444f-9813-60b037ee151d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:08.740986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1114/2218] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:08.745270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691efc1e-695f-478e-add4-e923be25f360 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:08.756638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691efc1e-695f-478e-add4-e923be25f360 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:08.762085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e395aa-8a60-41c6-90b7-f35a61b9b203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:08.762707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e395aa-8a60-41c6-90b7-f35a61b9b203 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.762995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e395aa-8a60-41c6-90b7-f35a61b9b203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.763453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e395aa-8a60-41c6-90b7-f35a61b9b203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.764115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e395aa-8a60-41c6-90b7-f35a61b9b203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:08.766213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e395aa-8a60-41c6-90b7-f35a61b9b203 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:08.781330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1105/2219] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:08.784442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4625d-011b-444f-9813-60b037ee151d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:08.794946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4625d-011b-444f-9813-60b037ee151d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:08.800609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e1055-ca6b-4382-85fe-14e12ff0f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:08.801094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e1055-ca6b-4382-85fe-14e12ff0f77e admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.801408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e1055-ca6b-4382-85fe-14e12ff0f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.801687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e1055-ca6b-4382-85fe-14e12ff0f77e admin admin] PATH_INFO: `/v3/projects/bd9e7c126653497ba52f25a7e03d004b/users/dd3f033dd8b943bc84e03f45b1c183c8/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.819610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e1055-ca6b-4382-85fe-14e12ff0f77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9e7c126653497ba52f25a7e03d004b, user_id=dd3f033dd8b943bc84e03f45b1c183c8, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:08.822470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e1055-ca6b-4382-85fe-14e12ff0f77e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:08.838830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1115/2220] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:08 2022] PUT /identity/v3/projects/bd9e7c126653497ba52f25a7e03d004b/users/dd3f033dd8b943bc84e03f45b1c183c8/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:08.849707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e08bf-5dc4-47e8-ba99-d4d72bc2da70 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:08.849997 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e08bf-5dc4-47e8-ba99-d4d72bc2da70 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:08.850273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e08bf-5dc4-47e8-ba99-d4d72bc2da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:08.880002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-840e08bf-5dc4-47e8-ba99-d4d72bc2da70 None None] MFA Rules not processed for user `dd3f033dd8b943bc84e03f45b1c183c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:08.881227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-840e08bf-5dc4-47e8-ba99-d4d72bc2da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:08.950112 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1106/2221] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:08.954670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e1055-ca6b-4382-85fe-14e12ff0f77e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:09.018746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e1055-ca6b-4382-85fe-14e12ff0f77e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:09.023595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3584a0-ab51-4c85-8620-ff00fb5f7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:09.024230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3584a0-ab51-4c85-8620-ff00fb5f7769 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.024568 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3584a0-ab51-4c85-8620-ff00fb5f7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.024850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3584a0-ab51-4c85-8620-ff00fb5f7769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.025510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3584a0-ab51-4c85-8620-ff00fb5f7769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:09.027480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3584a0-ab51-4c85-8620-ff00fb5f7769 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:09.060433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1116/2222] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:08 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:09.061681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e08bf-5dc4-47e8-ba99-d4d72bc2da70 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:09.073817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e08bf-5dc4-47e8-ba99-d4d72bc2da70 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:09.117744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3584a0-ab51-4c85-8620-ff00fb5f7769 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:09.119626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ec3584a0-ab51-4c85-8620-ff00fb5f7769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:09.137250 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da6437-b5a4-47ca-baf6-518002ae9c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:09.137918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da6437-b5a4-47ca-baf6-518002ae9c3e admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.138200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da6437-b5a4-47ca-baf6-518002ae9c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.138478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da6437-b5a4-47ca-baf6-518002ae9c3e admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.139127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da6437-b5a4-47ca-baf6-518002ae9c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:09.140837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:09.141052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da6437-b5a4-47ca-baf6-518002ae9c3e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:09.164437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1107/2223] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:09 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:09.168199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da6437-b5a4-47ca-baf6-518002ae9c3e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:09.178014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da6437-b5a4-47ca-baf6-518002ae9c3e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:09.182577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f7ac2-ab2e-4998-9b8a-21776d8d2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:09.183169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f7ac2-ab2e-4998-9b8a-21776d8d2ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.183429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f7ac2-ab2e-4998-9b8a-21776d8d2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.183706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f7ac2-ab2e-4998-9b8a-21776d8d2ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.184332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f7ac2-ab2e-4998-9b8a-21776d8d2ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:09.185950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f7ac2-ab2e-4998-9b8a-21776d8d2ab5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:09.190693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3584a0-ab51-4c85-8620-ff00fb5f7769 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:09.195875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:09.196521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.196808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.196987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1108/2224] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:09.200176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] PATH_INFO: `/v3/users/a3abce51d78645e581a0d9b16cbf7f48` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.200933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f7ac2-ab2e-4998-9b8a-21776d8d2ab5 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:09.202119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3abce51d78645e581a0d9b16cbf7f48)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:09.204330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:09.207729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:09.212505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f7ac2-ab2e-4998-9b8a-21776d8d2ab5 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:09.218901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaebe3-96b1-4760-a0cb-3b5c6803b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:09.219707 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaebe3-96b1-4760-a0cb-3b5c6803b986 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.219998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaebe3-96b1-4760-a0cb-3b5c6803b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.220276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaebe3-96b1-4760-a0cb-3b5c6803b986 admin admin] PATH_INFO: `/v3/projects/3d4362d270844cac829839053ec380c1/users/31f7c896e65b424783f2652b55add1d0/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.238503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaebe3-96b1-4760-a0cb-3b5c6803b986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4362d270844cac829839053ec380c1, user_id=31f7c896e65b424783f2652b55add1d0, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:09.241352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaebe3-96b1-4760-a0cb-3b5c6803b986 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:09.255170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1109/2225] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:09 2022] PUT /identity/v3/projects/3d4362d270844cac829839053ec380c1/users/31f7c896e65b424783f2652b55add1d0/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:09.258131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3abce51d78645e581a0d9b16cbf7f48'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:09.259225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaebe3-96b1-4760-a0cb-3b5c6803b986 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:09.266330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3abce51d78645e581a0d9b16cbf7f48'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:09.267149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3abce51d78645e581a0d9b16cbf7f48'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:09.281082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3abce51d78645e581a0d9b16cbf7f48'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:09.288374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-94f71899-7681-475a-a2f2-57db793fffc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3abce51d78645e581a0d9b16cbf7f48'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:09.295359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1117/2226] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:09 2022] DELETE /identity/v3/users/a3abce51d78645e581a0d9b16cbf7f48 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:09.300550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b210e8-e330-4d2a-99d9-9ebb92e4831a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.300828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b210e8-e330-4d2a-99d9-9ebb92e4831a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.301103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b210e8-e330-4d2a-99d9-9ebb92e4831a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.321207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-38b210e8-e330-4d2a-99d9-9ebb92e4831a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:09.322475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-38b210e8-e330-4d2a-99d9-9ebb92e4831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:09.336532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaebe3-96b1-4760-a0cb-3b5c6803b986 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:09.397044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1118/2227] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:09.408287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b210e8-e330-4d2a-99d9-9ebb92e4831a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:09.408464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7829fcd-f750-46c3-9de9-da3fccf09402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:09.409705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7829fcd-f750-46c3-9de9-da3fccf09402 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.409914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7829fcd-f750-46c3-9de9-da3fccf09402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.410193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7829fcd-f750-46c3-9de9-da3fccf09402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.410870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7829fcd-f750-46c3-9de9-da3fccf09402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:09.411131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-38b210e8-e330-4d2a-99d9-9ebb92e4831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:09.412506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7829fcd-f750-46c3-9de9-da3fccf09402 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:09.424012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1110/2228] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:09.428263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7829fcd-f750-46c3-9de9-da3fccf09402 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:09.430028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d7829fcd-f750-46c3-9de9-da3fccf09402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:09.442333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7829fcd-f750-46c3-9de9-da3fccf09402 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:09.446948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481af108-c1ab-426d-b612-c38eede71abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:09.447596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481af108-c1ab-426d-b612-c38eede71abe admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.447875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481af108-c1ab-426d-b612-c38eede71abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.448148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481af108-c1ab-426d-b612-c38eede71abe admin admin] PATH_INFO: `/v3/projects/3d4362d270844cac829839053ec380c1/users/31f7c896e65b424783f2652b55add1d0/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.450042 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481af108-c1ab-426d-b612-c38eede71abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4362d270844cac829839053ec380c1, user_id=31f7c896e65b424783f2652b55add1d0, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:09.452715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481af108-c1ab-426d-b612-c38eede71abe admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:09.463896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1111/2229] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:09 2022] PUT /identity/v3/projects/3d4362d270844cac829839053ec380c1/users/31f7c896e65b424783f2652b55add1d0/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:09.474546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:09.475927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445fdbf-05fc-4ee5-b9b6-774d6fd8ba0a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.476221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445fdbf-05fc-4ee5-b9b6-774d6fd8ba0a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.476555 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445fdbf-05fc-4ee5-b9b6-774d6fd8ba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.496901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b210e8-e330-4d2a-99d9-9ebb92e4831a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:09.505904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-0445fdbf-05fc-4ee5-b9b6-774d6fd8ba0a None None] MFA Rules not processed for user `31f7c896e65b424783f2652b55add1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:09.507118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-0445fdbf-05fc-4ee5-b9b6-774d6fd8ba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:09.560635 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7a37-0ef3-4bca-9eb4-ef516f4672e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:09.561294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7a37-0ef3-4bca-9eb4-ef516f4672e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.561607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7a37-0ef3-4bca-9eb4-ef516f4672e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.561989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7a37-0ef3-4bca-9eb4-ef516f4672e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.588909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:09.600455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1112/2230] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:09.613687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445fdbf-05fc-4ee5-b9b6-774d6fd8ba0a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:09.615302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-0445fdbf-05fc-4ee5-b9b6-774d6fd8ba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:09.631339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7a37-0ef3-4bca-9eb4-ef516f4672e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:09.633075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7a37-0ef3-4bca-9eb4-ef516f4672e9 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:09.645408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1119/2231] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:27:09.682885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445fdbf-05fc-4ee5-b9b6-774d6fd8ba0a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:09.686771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448d3fc-fb2c-4af1-b20c-8c7a5d019bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:09.687404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448d3fc-fb2c-4af1-b20c-8c7a5d019bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:09.687686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448d3fc-fb2c-4af1-b20c-8c7a5d019bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:09.687959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448d3fc-fb2c-4af1-b20c-8c7a5d019bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:09.698791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448d3fc-fb2c-4af1-b20c-8c7a5d019bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:09.699663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448d3fc-fb2c-4af1-b20c-8c7a5d019bf4 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:09.711021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1113/2232] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:27:10.050078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7a37-0ef3-4bca-9eb4-ef516f4672e9 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:10.052553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ddee7a37-0ef3-4bca-9eb4-ef516f4672e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:10.068671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7a37-0ef3-4bca-9eb4-ef516f4672e9 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:10.074629 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:10.076089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:10.076555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:10.076982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] PATH_INFO: `/v3/projects/6a136bd3c06a49c8be9439ecfe4fcf89` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:10.079044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a136bd3c06a49c8be9439ecfe4fcf89)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:10.082251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:10.154260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a136bd3c06a49c8be9439ecfe4fcf89', 'request_id': 'req-e9111286-da2f-4793-b6ec-140a0fee8bb1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.164729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a136bd3c06a49c8be9439ecfe4fcf89', 'request_id': 'req-e9111286-da2f-4793-b6ec-140a0fee8bb1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.174988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a136bd3c06a49c8be9439ecfe4fcf89', 'request_id': 'req-e9111286-da2f-4793-b6ec-140a0fee8bb1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.201978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] The token cache is being invalidate because project 6a136bd3c06a49c8be9439ecfe4fcf89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:10.202616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.203685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.210436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1120/2233] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:10 2022] DELETE /identity/v3/projects/6a136bd3c06a49c8be9439ecfe4fcf89 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:10.212155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448d3fc-fb2c-4af1-b20c-8c7a5d019bf4 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:10.227918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448d3fc-fb2c-4af1-b20c-8c7a5d019bf4 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:10.300655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:10.301345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:10.301632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:10.301916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] PATH_INFO: `/v3/users/2b0709b0e0334ee98bb36b11bd0109e7` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:10.303064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0709b0e0334ee98bb36b11bd0109e7)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:10.305185 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:10.359283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0709b0e0334ee98bb36b11bd0109e7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.368095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0709b0e0334ee98bb36b11bd0109e7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.368742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0709b0e0334ee98bb36b11bd0109e7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.384620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0709b0e0334ee98bb36b11bd0109e7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.392488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0709b0e0334ee98bb36b11bd0109e7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.400759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1114/2234] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:10 2022] DELETE /identity/v3/users/2b0709b0e0334ee98bb36b11bd0109e7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:10.696051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:10.698115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:10.725643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111286-da2f-4793-b6ec-140a0fee8bb1 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:10.750012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:10.792848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:10.793632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:10.794090 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:10.794402 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] PATH_INFO: `/v3/projects/3cd40e64f26c45b6b084407160f5c035` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:10.795869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd40e64f26c45b6b084407160f5c035)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:10.798361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:10.852089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd40e64f26c45b6b084407160f5c035', 'request_id': 'req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.862849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd40e64f26c45b6b084407160f5c035', 'request_id': 'req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.870596 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd40e64f26c45b6b084407160f5c035', 'request_id': 'req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.888467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] The token cache is being invalidate because project 3cd40e64f26c45b6b084407160f5c035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:10.888808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.889445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:10.891061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1121/2235] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:10 2022] DELETE /identity/v3/projects/3cd40e64f26c45b6b084407160f5c035 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:10.895924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:10.897524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:10.912682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8091b48-55e2-4041-831b-cb4bdcf91a32 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:10.926122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:10.993054 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:10.993975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:10.994448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:10.994795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] PATH_INFO: `/v3/users/7d6f02b7443e4b66a845c26701df37fc` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:10.996255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6f02b7443e4b66a845c26701df37fc)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:11.001764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:11.059716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6f02b7443e4b66a845c26701df37fc'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.068218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6f02b7443e4b66a845c26701df37fc'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.068950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6f02b7443e4b66a845c26701df37fc'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.085016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6f02b7443e4b66a845c26701df37fc'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.093944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6f02b7443e4b66a845c26701df37fc'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.102747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1115/2236] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:10 2022] DELETE /identity/v3/users/7d6f02b7443e4b66a845c26701df37fc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:11.411197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:11.412731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.432534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:11.434349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.448774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347de97-1b29-4cfb-bb40-bc49a6ef5c15 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:11.524961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:11.525662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:11.526012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:11.526201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] PATH_INFO: `/v3/users/dd3f033dd8b943bc84e03f45b1c183c8` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:11.527513 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3f033dd8b943bc84e03f45b1c183c8)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:11.530902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:11.539534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb52d89-c5c2-43c8-8bfa-7853d18732b5 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:11.548117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:11.548914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:11.549857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:11.550911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] PATH_INFO: `/v3/projects/39b0ea2d13d8419c8ad51ec69a964c58` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:11.552915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b0ea2d13d8419c8ad51ec69a964c58)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:11.555147 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:11.599801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:11.603025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3f033dd8b943bc84e03f45b1c183c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.609132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b0ea2d13d8419c8ad51ec69a964c58', 'request_id': 'req-6f686faa-1db7-4487-8527-63f12745b5a1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.616180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3f033dd8b943bc84e03f45b1c183c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.617251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3f033dd8b943bc84e03f45b1c183c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.619911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:11.623046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b0ea2d13d8419c8ad51ec69a964c58', 'request_id': 'req-6f686faa-1db7-4487-8527-63f12745b5a1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.631753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b0ea2d13d8419c8ad51ec69a964c58', 'request_id': 'req-6f686faa-1db7-4487-8527-63f12745b5a1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.638237 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3f033dd8b943bc84e03f45b1c183c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.646583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] The token cache is being invalidate because project 39b0ea2d13d8419c8ad51ec69a964c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:11.646746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2870ebb3-29dc-42c8-9af3-00139172ed0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3f033dd8b943bc84e03f45b1c183c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.646866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.647516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.649210 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1116/2237] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:11 2022] DELETE /identity/v3/projects/39b0ea2d13d8419c8ad51ec69a964c58 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:11.649923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:11.651230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.652751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1122/2238] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:11 2022] DELETE /identity/v3/users/dd3f033dd8b943bc84e03f45b1c183c8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:11.654174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f251c-dc28-4d76-9502-0a7ad8574b50 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:11.654529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f251c-dc28-4d76-9502-0a7ad8574b50 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:11.654827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f251c-dc28-4d76-9502-0a7ad8574b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:11.680980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2c3f251c-dc28-4d76-9502-0a7ad8574b50 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:11.682792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2c3f251c-dc28-4d76-9502-0a7ad8574b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.725782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f686faa-1db7-4487-8527-63f12745b5a1 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:11.747418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1123/2239] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:11.748632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fed0-12ef-4303-b26d-f436c7fd65cd None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:11.748920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fed0-12ef-4303-b26d-f436c7fd65cd None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:11.749195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fed0-12ef-4303-b26d-f436c7fd65cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:11.770453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-9801fed0-12ef-4303-b26d-f436c7fd65cd None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:11.771776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9801fed0-12ef-4303-b26d-f436c7fd65cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.779589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1124/2240] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:11.782720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0466-ab26-413c-8e7d-6570f68192d5 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:11.783008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0466-ab26-413c-8e7d-6570f68192d5 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:11.783415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0466-ab26-413c-8e7d-6570f68192d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:11.793091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:11.793780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:11.794069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:11.794353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] PATH_INFO: `/v3/users/9ab2e106e0fa4becaaac29caf3b69176` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:11.795526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab2e106e0fa4becaaac29caf3b69176)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:11.797531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:11.804845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-64ec0466-ab26-413c-8e7d-6570f68192d5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:11.806596 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-64ec0466-ab26-413c-8e7d-6570f68192d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.815655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1125/2241] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:11.816601 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec0466-ab26-413c-8e7d-6570f68192d5 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:11.817950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-64ec0466-ab26-413c-8e7d-6570f68192d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.859398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab2e106e0fa4becaaac29caf3b69176'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.867401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab2e106e0fa4becaaac29caf3b69176'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.868199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab2e106e0fa4becaaac29caf3b69176'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.882181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab2e106e0fa4becaaac29caf3b69176'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.882667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec0466-ab26-413c-8e7d-6570f68192d5 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:11.886964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21da353-8ef8-4742-9027-c15641496d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:11.887107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:11.887771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21da353-8ef8-4742-9027-c15641496d77 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:11.887955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21da353-8ef8-4742-9027-c15641496d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:11.888528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21da353-8ef8-4742-9027-c15641496d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:11.890327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d21da353-8ef8-4742-9027-c15641496d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.890780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab2e106e0fa4becaaac29caf3b69176'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:11.900000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1117/2242] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:11 2022] DELETE /identity/v3/users/9ab2e106e0fa4becaaac29caf3b69176 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:11.903545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:11.904416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21da353-8ef8-4742-9027-c15641496d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:11.904929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.905927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21da353-8ef8-4742-9027-c15641496d77 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:11.916908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1126/2243] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:11.918413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2863b-df35-4c89-95db-0dc7ef23a5ac None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:11.918777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2863b-df35-4c89-95db-0dc7ef23a5ac None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:11.919184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2863b-df35-4c89-95db-0dc7ef23a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:11.939051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1de2863b-df35-4c89-95db-0dc7ef23a5ac None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:11.943077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1de2863b-df35-4c89-95db-0dc7ef23a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:11.989102 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f039d43-e857-425d-81f3-5676d47e9d60 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:11.994702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51b8d-37f8-4bc0-ad95-6b50d77665b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:11.996237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51b8d-37f8-4bc0-ad95-6b50d77665b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:11.996551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51b8d-37f8-4bc0-ad95-6b50d77665b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:11.996859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51b8d-37f8-4bc0-ad95-6b50d77665b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:11.997960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51b8d-37f8-4bc0-ad95-6b50d77665b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:11.998237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51b8d-37f8-4bc0-ad95-6b50d77665b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:11.999917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51b8d-37f8-4bc0-ad95-6b50d77665b1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.015505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1118/2244] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:27:12.021314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51b8d-37f8-4bc0-ad95-6b50d77665b1 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.032387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1127/2245] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:12.034528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51b8d-37f8-4bc0-ad95-6b50d77665b1 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.039992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39f28a-fe6f-4d61-bcc0-73f9f86adf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.040620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39f28a-fe6f-4d61-bcc0-73f9f86adf26 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.040933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39f28a-fe6f-4d61-bcc0-73f9f86adf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.041168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39f28a-fe6f-4d61-bcc0-73f9f86adf26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.042067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39f28a-fe6f-4d61-bcc0-73f9f86adf26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.043232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2863b-df35-4c89-95db-0dc7ef23a5ac None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.044009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39f28a-fe6f-4d61-bcc0-73f9f86adf26 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.045222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1de2863b-df35-4c89-95db-0dc7ef23a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:12.052826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:12.086439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1119/2246] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:12 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:12.088233 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39f28a-fe6f-4d61-bcc0-73f9f86adf26 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.118698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2863b-df35-4c89-95db-0dc7ef23a5ac None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.181171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39f28a-fe6f-4d61-bcc0-73f9f86adf26 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.186750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ad6d-8a59-4394-b51a-d9af50e38187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.187407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ad6d-8a59-4394-b51a-d9af50e38187 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.187669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ad6d-8a59-4394-b51a-d9af50e38187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.187947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ad6d-8a59-4394-b51a-d9af50e38187 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.188580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52ad6d-8a59-4394-b51a-d9af50e38187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.189768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2fa3a-19cd-4ad2-8420-2bd32994d325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.190237 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2fa3a-19cd-4ad2-8420-2bd32994d325 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.190621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2fa3a-19cd-4ad2-8420-2bd32994d325 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.190957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52ad6d-8a59-4394-b51a-d9af50e38187 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.191064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2fa3a-19cd-4ad2-8420-2bd32994d325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.201563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2fa3a-19cd-4ad2-8420-2bd32994d325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.203359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2fa3a-19cd-4ad2-8420-2bd32994d325 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.216469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1128/2247] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:12.223527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1120/2248] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:12 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:12.225108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2fa3a-19cd-4ad2-8420-2bd32994d325 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.237142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2fa3a-19cd-4ad2-8420-2bd32994d325 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.242499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d0e3-9a60-4f3b-8832-9a1331636ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.243314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d0e3-9a60-4f3b-8832-9a1331636ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.243982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d0e3-9a60-4f3b-8832-9a1331636ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.244364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d0e3-9a60-4f3b-8832-9a1331636ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.245559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8d0e3-9a60-4f3b-8832-9a1331636ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.247119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8d0e3-9a60-4f3b-8832-9a1331636ec2 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.261282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1129/2249] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:12.263718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ad6d-8a59-4394-b51a-d9af50e38187 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.275957 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ad6d-8a59-4394-b51a-d9af50e38187 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.284790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a14d0-db1e-49e9-a723-5507b36ed3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.285626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a14d0-db1e-49e9-a723-5507b36ed3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.286063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a14d0-db1e-49e9-a723-5507b36ed3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.286810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a14d0-db1e-49e9-a723-5507b36ed3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.287903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a14d0-db1e-49e9-a723-5507b36ed3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.289787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a14d0-db1e-49e9-a723-5507b36ed3b8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.304604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1121/2250] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:12.310168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d0e3-9a60-4f3b-8832-9a1331636ec2 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.325688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a14d0-db1e-49e9-a723-5507b36ed3b8 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.327550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-885a14d0-db1e-49e9-a723-5507b36ed3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:12.328161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d0e3-9a60-4f3b-8832-9a1331636ec2 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.337136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b96ce6-7143-401d-b65e-55725477d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.338264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b96ce6-7143-401d-b65e-55725477d6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.338694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b96ce6-7143-401d-b65e-55725477d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.338988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b96ce6-7143-401d-b65e-55725477d6a8 admin admin] PATH_INFO: `/v3/projects/7ec701b2c1a3481f9936c380eb2380ee/users/11957165d77e4a2295a21dae4880cf5d/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.351019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a14d0-db1e-49e9-a723-5507b36ed3b8 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.356644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.357472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.357848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.358390 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] PATH_INFO: `/v3/projects/bd9e7c126653497ba52f25a7e03d004b` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.359882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9e7c126653497ba52f25a7e03d004b)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.361833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b96ce6-7143-401d-b65e-55725477d6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec701b2c1a3481f9936c380eb2380ee, user_id=11957165d77e4a2295a21dae4880cf5d, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.362812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.371798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b96ce6-7143-401d-b65e-55725477d6a8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.411777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1130/2251] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:12 2022] PUT /identity/v3/projects/7ec701b2c1a3481f9936c380eb2380ee/users/11957165d77e4a2295a21dae4880cf5d/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:12.414763 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b1424-638c-4cf3-9fc9-8d867f0f0f80 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.415175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b1424-638c-4cf3-9fc9-8d867f0f0f80 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.415521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b1424-638c-4cf3-9fc9-8d867f0f0f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.426619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:12.437285 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9e7c126653497ba52f25a7e03d004b', 'request_id': 'req-23951c0d-5d0e-4d4c-944a-d973f3953f7e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.440378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-818b1424-638c-4cf3-9fc9-8d867f0f0f80 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:12.441659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-818b1424-638c-4cf3-9fc9-8d867f0f0f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:12.447162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9e7c126653497ba52f25a7e03d004b', 'request_id': 'req-23951c0d-5d0e-4d4c-944a-d973f3953f7e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.456132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9e7c126653497ba52f25a7e03d004b', 'request_id': 'req-23951c0d-5d0e-4d4c-944a-d973f3953f7e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.470658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] The token cache is being invalidate because project bd9e7c126653497ba52f25a7e03d004b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:12.471044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.472462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.474209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1122/2252] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:12 2022] DELETE /identity/v3/projects/bd9e7c126653497ba52f25a7e03d004b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:12.478190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.479909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:12.510953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1131/2253] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:12.522529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b1424-638c-4cf3-9fc9-8d867f0f0f80 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.524041 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-818b1424-638c-4cf3-9fc9-8d867f0f0f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:12.559931 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951c0d-5d0e-4d4c-944a-d973f3953f7e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.561952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:12.568002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.568657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.568946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.569224 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] PATH_INFO: `/v3/users/31f7c896e65b424783f2652b55add1d0` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.570418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f7c896e65b424783f2652b55add1d0)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.572353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.599987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b1424-638c-4cf3-9fc9-8d867f0f0f80 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.605220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903294a-b6c2-422e-817d-f3f3e5af2978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.608211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903294a-b6c2-422e-817d-f3f3e5af2978 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.608211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903294a-b6c2-422e-817d-f3f3e5af2978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.608211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903294a-b6c2-422e-817d-f3f3e5af2978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.619253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903294a-b6c2-422e-817d-f3f3e5af2978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.620948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903294a-b6c2-422e-817d-f3f3e5af2978 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.627065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f7c896e65b424783f2652b55add1d0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.635830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1132/2254] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:27:12.637150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f7c896e65b424783f2652b55add1d0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.638106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f7c896e65b424783f2652b55add1d0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.642829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903294a-b6c2-422e-817d-f3f3e5af2978 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:12.644504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c903294a-b6c2-422e-817d-f3f3e5af2978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:12.657159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f7c896e65b424783f2652b55add1d0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.662301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903294a-b6c2-422e-817d-f3f3e5af2978 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:12.670981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:12.671894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.672661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.673207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] PATH_INFO: `/v3/projects/8b5a07e26d8a48d99d50a9f71e963297` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.675856 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cd0a373a-53ae-4852-8eff-41a98e4fd85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f7c896e65b424783f2652b55add1d0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.676885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5a07e26d8a48d99d50a9f71e963297)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:12.680617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:12.687200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1123/2255] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:12 2022] DELETE /identity/v3/users/31f7c896e65b424783f2652b55add1d0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:12.781332 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5a07e26d8a48d99d50a9f71e963297', 'request_id': 'req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.790346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5a07e26d8a48d99d50a9f71e963297', 'request_id': 'req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.801118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5a07e26d8a48d99d50a9f71e963297', 'request_id': 'req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.824374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] The token cache is being invalidate because project 8b5a07e26d8a48d99d50a9f71e963297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:12.824719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.826773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c352a6c1-9bf5-4505-949d-e36ab4be3ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:12.829132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1133/2256] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:12 2022] DELETE /identity/v3/projects/8b5a07e26d8a48d99d50a9f71e963297 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:12.834531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f37e3-c712-4336-886e-3f1dcb556c20 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:12.834883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f37e3-c712-4336-886e-3f1dcb556c20 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:12.835165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f37e3-c712-4336-886e-3f1dcb556c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:12.882596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-139f37e3-c712-4336-886e-3f1dcb556c20 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:12.883843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-139f37e3-c712-4336-886e-3f1dcb556c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:12.983930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:13.012459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1124/2257] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:13.021576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f484a-3372-4160-85a5-acd62cc68bfa None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.021856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f484a-3372-4160-85a5-acd62cc68bfa None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.022127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f484a-3372-4160-85a5-acd62cc68bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.042386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-565f484a-3372-4160-85a5-acd62cc68bfa None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:13.043415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-565f484a-3372-4160-85a5-acd62cc68bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:13.052887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1134/2258] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:13.057058 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f37e3-c712-4336-886e-3f1dcb556c20 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.067763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f37e3-c712-4336-886e-3f1dcb556c20 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.072470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e72a6-46bb-4c3b-8f3d-7dbddbbc67f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.073290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e72a6-46bb-4c3b-8f3d-7dbddbbc67f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.073481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e72a6-46bb-4c3b-8f3d-7dbddbbc67f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.073731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e72a6-46bb-4c3b-8f3d-7dbddbbc67f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.074392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e72a6-46bb-4c3b-8f3d-7dbddbbc67f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:13.074696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e72a6-46bb-4c3b-8f3d-7dbddbbc67f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.076384 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e72a6-46bb-4c3b-8f3d-7dbddbbc67f8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.088922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1125/2259] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:27:13.093211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f484a-3372-4160-85a5-acd62cc68bfa None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.104098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f484a-3372-4160-85a5-acd62cc68bfa None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.109169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0eae-8584-4502-bfcf-ebcbbfcc0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.109817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0eae-8584-4502-bfcf-ebcbbfcc0297 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.110100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0eae-8584-4502-bfcf-ebcbbfcc0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.110377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0eae-8584-4502-bfcf-ebcbbfcc0297 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.111094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b0eae-8584-4502-bfcf-ebcbbfcc0297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.113718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b0eae-8584-4502-bfcf-ebcbbfcc0297 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.151657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1135/2260] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:13 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:13.152813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e72a6-46bb-4c3b-8f3d-7dbddbbc67f8 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.166926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e72a6-46bb-4c3b-8f3d-7dbddbbc67f8 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.179356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0eae-8584-4502-bfcf-ebcbbfcc0297 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.181824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d16b0eae-8584-4502-bfcf-ebcbbfcc0297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:13.250218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b4094-22ef-471a-8083-6651e3f0df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.250874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b4094-22ef-471a-8083-6651e3f0df36 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.251140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b4094-22ef-471a-8083-6651e3f0df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.251428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b4094-22ef-471a-8083-6651e3f0df36 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.252216 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b4094-22ef-471a-8083-6651e3f0df36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.255041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b4094-22ef-471a-8083-6651e3f0df36 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.275782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0eae-8584-4502-bfcf-ebcbbfcc0297 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.280996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.281694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.281982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.282800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1126/2261] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:13 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:13.282922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] PATH_INFO: `/v3/projects/3d4362d270844cac829839053ec380c1` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.283463 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4362d270844cac829839053ec380c1)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.285665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.286332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b4094-22ef-471a-8083-6651e3f0df36 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.300214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b4094-22ef-471a-8083-6651e3f0df36 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.305377 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dbbe7-81a3-4414-955a-8be453d32ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.306081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dbbe7-81a3-4414-955a-8be453d32ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.306412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dbbe7-81a3-4414-955a-8be453d32ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.306806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dbbe7-81a3-4414-955a-8be453d32ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.307518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dbbe7-81a3-4414-955a-8be453d32ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.309221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dbbe7-81a3-4414-955a-8be453d32ad4 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.321546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1127/2262] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:13.325611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dbbe7-81a3-4414-955a-8be453d32ad4 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.333984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:13.341685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dbbe7-81a3-4414-955a-8be453d32ad4 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.357034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4362d270844cac829839053ec380c1', 'request_id': 'req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:13.367918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4362d270844cac829839053ec380c1', 'request_id': 'req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:13.379461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4362d270844cac829839053ec380c1', 'request_id': 'req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:13.403936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] The token cache is being invalidate because project 3d4362d270844cac829839053ec380c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:13.404335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:13.405178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fccb0ab8-a22b-4427-a10b-2db4179ea3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:13.407684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1136/2263] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:13 2022] DELETE /identity/v3/projects/3d4362d270844cac829839053ec380c1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:13.414417 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6edb-00b6-4770-990c-d937962f82f1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.415027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6edb-00b6-4770-990c-d937962f82f1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.415618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6edb-00b6-4770-990c-d937962f82f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.444715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-499b6edb-00b6-4770-990c-d937962f82f1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:13.446427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-499b6edb-00b6-4770-990c-d937962f82f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:13.449298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342969b3-bf4f-4654-89d1-de1fb0520ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.450924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342969b3-bf4f-4654-89d1-de1fb0520ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.451271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342969b3-bf4f-4654-89d1-de1fb0520ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.451649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342969b3-bf4f-4654-89d1-de1fb0520ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.452508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342969b3-bf4f-4654-89d1-de1fb0520ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.454260 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342969b3-bf4f-4654-89d1-de1fb0520ebb admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.462560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1137/2264] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:13.470448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e428c7-31b5-4cf0-ae4c-f2690d8edb26 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.471011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e428c7-31b5-4cf0-ae4c-f2690d8edb26 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.472118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e428c7-31b5-4cf0-ae4c-f2690d8edb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.482799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1128/2265] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:13.484491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342969b3-bf4f-4654-89d1-de1fb0520ebb admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.487784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-342969b3-bf4f-4654-89d1-de1fb0520ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:13.505408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342969b3-bf4f-4654-89d1-de1fb0520ebb admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.511519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-67e428c7-31b5-4cf0-ae4c-f2690d8edb26 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:13.512548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a51c8-24dd-4f43-98de-70450d11e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.513381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a51c8-24dd-4f43-98de-70450d11e4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.513525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-67e428c7-31b5-4cf0-ae4c-f2690d8edb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:13.513722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a51c8-24dd-4f43-98de-70450d11e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.514125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a51c8-24dd-4f43-98de-70450d11e4e3 admin admin] PATH_INFO: `/v3/projects/8a178debf57d4ddebedcad5574a6ccb4/users/fc68b2265f7e43cb900b5b7f2f5f02a0/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.532854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1138/2266] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:13.538192 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e428c7-31b5-4cf0-ae4c-f2690d8edb26 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.540790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a51c8-24dd-4f43-98de-70450d11e4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a178debf57d4ddebedcad5574a6ccb4, user_id=fc68b2265f7e43cb900b5b7f2f5f02a0, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.543612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a51c8-24dd-4f43-98de-70450d11e4e3 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.552342 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e428c7-31b5-4cf0-ae4c-f2690d8edb26 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.561682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09013bc-6564-45e6-a1b4-caa350afdcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.562397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09013bc-6564-45e6-a1b4-caa350afdcfb admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.562725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09013bc-6564-45e6-a1b4-caa350afdcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.563035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09013bc-6564-45e6-a1b4-caa350afdcfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.564222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09013bc-6564-45e6-a1b4-caa350afdcfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:13.564569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09013bc-6564-45e6-a1b4-caa350afdcfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.566105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1129/2267] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:13 2022] PUT /identity/v3/projects/8a178debf57d4ddebedcad5574a6ccb4/users/fc68b2265f7e43cb900b5b7f2f5f02a0/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:13.576294 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93103cfa-2684-4fd6-af7c-5a78777328c5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.577287 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93103cfa-2684-4fd6-af7c-5a78777328c5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.577435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09013bc-6564-45e6-a1b4-caa350afdcfb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.577883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93103cfa-2684-4fd6-af7c-5a78777328c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.600543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1139/2268] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:27:13.606201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09013bc-6564-45e6-a1b4-caa350afdcfb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.628668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-93103cfa-2684-4fd6-af7c-5a78777328c5 None None] MFA Rules not processed for user `fc68b2265f7e43cb900b5b7f2f5f02a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:13.630107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-93103cfa-2684-4fd6-af7c-5a78777328c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:13.637408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09013bc-6564-45e6-a1b4-caa350afdcfb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.650456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:13.742764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1130/2269] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:13.744310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac51bbf-a1ec-4843-b16d-d92522e9a628 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.744611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac51bbf-a1ec-4843-b16d-d92522e9a628 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.744891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac51bbf-a1ec-4843-b16d-d92522e9a628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.760806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdfb3b-4d09-4d23-abed-3f432621b7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.761506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdfb3b-4d09-4d23-abed-3f432621b7cc admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.762226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdfb3b-4d09-4d23-abed-3f432621b7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.762543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdfb3b-4d09-4d23-abed-3f432621b7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.763362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdfb3b-4d09-4d23-abed-3f432621b7cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.765803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdfb3b-4d09-4d23-abed-3f432621b7cc admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.775228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-fac51bbf-a1ec-4843-b16d-d92522e9a628 None None] MFA Rules not processed for user `11957165d77e4a2295a21dae4880cf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:13.776508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-fac51bbf-a1ec-4843-b16d-d92522e9a628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:13.805073 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1140/2270] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:13 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:13.806049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdfb3b-4d09-4d23-abed-3f432621b7cc admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.808465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-bcbdfb3b-4d09-4d23-abed-3f432621b7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:13.856787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1131/2271] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:13.857781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac51bbf-a1ec-4843-b16d-d92522e9a628 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.869831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac51bbf-a1ec-4843-b16d-d92522e9a628 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.885753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdfb3b-4d09-4d23-abed-3f432621b7cc admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.889570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdbade-2723-43c5-9c50-149be5fbac49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.890206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdbade-2723-43c5-9c50-149be5fbac49 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.890489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdbade-2723-43c5-9c50-149be5fbac49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.890765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdbade-2723-43c5-9c50-149be5fbac49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.920356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:13.938315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ca393-8b9c-4f5a-970d-cfa2e71e4830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.938945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ca393-8b9c-4f5a-970d-cfa2e71e4830 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.939231 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ca393-8b9c-4f5a-970d-cfa2e71e4830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.939520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ca393-8b9c-4f5a-970d-cfa2e71e4830 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.940754 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ca393-8b9c-4f5a-970d-cfa2e71e4830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.942758 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ca393-8b9c-4f5a-970d-cfa2e71e4830 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.951233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdbade-2723-43c5-9c50-149be5fbac49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.952671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdbade-2723-43c5-9c50-149be5fbac49 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:13.963974 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1141/2272] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:13.964661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdbade-2723-43c5-9c50-149be5fbac49 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.965789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1132/2273] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:13 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:13.968851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d0cdbade-2723-43c5-9c50-149be5fbac49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:13.970034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ca393-8b9c-4f5a-970d-cfa2e71e4830 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:13.979360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdbade-2723-43c5-9c50-149be5fbac49 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.980472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ca393-8b9c-4f5a-970d-cfa2e71e4830 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:13.983814 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e01950-85dc-4cad-90a2-8def01a70bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.984478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e01950-85dc-4cad-90a2-8def01a70bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.984715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e01950-85dc-4cad-90a2-8def01a70bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.985108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e01950-85dc-4cad-90a2-8def01a70bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.985685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24014f34-2cbe-43a6-a1e3-3f0222ab7667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:13.986292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24014f34-2cbe-43a6-a1e3-3f0222ab7667 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:13.986579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24014f34-2cbe-43a6-a1e3-3f0222ab7667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:13.987390 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24014f34-2cbe-43a6-a1e3-3f0222ab7667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:13.988062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24014f34-2cbe-43a6-a1e3-3f0222ab7667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:13.990052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24014f34-2cbe-43a6-a1e3-3f0222ab7667 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.001850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1133/2274] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:14.007308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24014f34-2cbe-43a6-a1e3-3f0222ab7667 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:14.019365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24014f34-2cbe-43a6-a1e3-3f0222ab7667 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:14.027898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dba13-e8d6-43bd-811a-c2b69588bf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:14.029512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dba13-e8d6-43bd-811a-c2b69588bf93 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.030254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dba13-e8d6-43bd-811a-c2b69588bf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.030776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dba13-e8d6-43bd-811a-c2b69588bf93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.031688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dba13-e8d6-43bd-811a-c2b69588bf93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:14.034224 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dba13-e8d6-43bd-811a-c2b69588bf93 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.046354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1134/2275] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:14.050771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dba13-e8d6-43bd-811a-c2b69588bf93 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:14.059360 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e01950-85dc-4cad-90a2-8def01a70bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:14.060770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e01950-85dc-4cad-90a2-8def01a70bd1 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.061122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dba13-e8d6-43bd-811a-c2b69588bf93 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:14.066877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac6cd-9079-4fcb-8109-48a7156f06ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:14.067657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac6cd-9079-4fcb-8109-48a7156f06ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.067947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac6cd-9079-4fcb-8109-48a7156f06ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.068228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac6cd-9079-4fcb-8109-48a7156f06ef admin admin] PATH_INFO: `/v3/projects/04346fc87de048898666cf80ebe928e3/users/d9410dd829084791bb892e1f4e7dfa13/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.071544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1142/2276] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:14.088564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:14.096760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ac6cd-9079-4fcb-8109-48a7156f06ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=04346fc87de048898666cf80ebe928e3, user_id=d9410dd829084791bb892e1f4e7dfa13, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:14.099635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ac6cd-9079-4fcb-8109-48a7156f06ef admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.114646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1135/2277] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:14 2022] PUT /identity/v3/projects/04346fc87de048898666cf80ebe928e3/users/d9410dd829084791bb892e1f4e7dfa13/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:14.125941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a745c-ec6e-427b-a28d-2ca27513592b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.126508 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a745c-ec6e-427b-a28d-2ca27513592b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.126927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a745c-ec6e-427b-a28d-2ca27513592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.161970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e36a745c-ec6e-427b-a28d-2ca27513592b None None] MFA Rules not processed for user `d9410dd829084791bb892e1f4e7dfa13`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:14.162553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e36a745c-ec6e-427b-a28d-2ca27513592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:14.254911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1143/2278] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:14.256066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac6cd-9079-4fcb-8109-48a7156f06ef admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:14.367937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac6cd-9079-4fcb-8109-48a7156f06ef admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:14.384736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12606e4-44dc-44f0-afef-46647f425ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:14.386488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12606e4-44dc-44f0-afef-46647f425ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.387853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12606e4-44dc-44f0-afef-46647f425ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.390970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12606e4-44dc-44f0-afef-46647f425ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.396062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12606e4-44dc-44f0-afef-46647f425ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:14.398992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12606e4-44dc-44f0-afef-46647f425ce7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.448899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1136/2279] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:14 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:14.452723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a745c-ec6e-427b-a28d-2ca27513592b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:14.466920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a745c-ec6e-427b-a28d-2ca27513592b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:14.538318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:14.546392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486e94-e06a-48cc-912c-f65e6370476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:14.547005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486e94-e06a-48cc-912c-f65e6370476a admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.547291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486e94-e06a-48cc-912c-f65e6370476a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.547566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486e94-e06a-48cc-912c-f65e6370476a admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.548203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c486e94-e06a-48cc-912c-f65e6370476a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:14.550200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c486e94-e06a-48cc-912c-f65e6370476a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.572369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1144/2280] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:14 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:14.577371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12606e4-44dc-44f0-afef-46647f425ce7 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:14.589640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12606e4-44dc-44f0-afef-46647f425ce7 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:14.594628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e34e2a-5048-4c49-a6bd-501df95244f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:14.595251 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e34e2a-5048-4c49-a6bd-501df95244f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.595674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e34e2a-5048-4c49-a6bd-501df95244f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.595961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e34e2a-5048-4c49-a6bd-501df95244f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.597176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e34e2a-5048-4c49-a6bd-501df95244f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:14.598797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e34e2a-5048-4c49-a6bd-501df95244f6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.625793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1137/2281] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:14.630192 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486e94-e06a-48cc-912c-f65e6370476a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:14.640138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486e94-e06a-48cc-912c-f65e6370476a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:14.645760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d2997-e82a-4a58-96c3-9df8fd1825df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:14.646348 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d2997-e82a-4a58-96c3-9df8fd1825df admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.646627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d2997-e82a-4a58-96c3-9df8fd1825df admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.646900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d2997-e82a-4a58-96c3-9df8fd1825df admin admin] PATH_INFO: `/v3/projects/5aa45078426a4ee69a44914030102a31/users/bbec54441c40426698108a08e57ea4ec/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.664784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d2997-e82a-4a58-96c3-9df8fd1825df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa45078426a4ee69a44914030102a31, user_id=bbec54441c40426698108a08e57ea4ec, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:14.667483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d2997-e82a-4a58-96c3-9df8fd1825df admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.683641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1145/2282] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:14 2022] PUT /identity/v3/projects/5aa45078426a4ee69a44914030102a31/users/bbec54441c40426698108a08e57ea4ec/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:14.691998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e34e2a-5048-4c49-a6bd-501df95244f6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:14.704407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e34e2a-5048-4c49-a6bd-501df95244f6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:14.770163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630fc67-a698-41ce-9e6a-d9611e46fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:14.770793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630fc67-a698-41ce-9e6a-d9611e46fe22 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.771077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630fc67-a698-41ce-9e6a-d9611e46fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.771420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630fc67-a698-41ce-9e6a-d9611e46fe22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.772074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630fc67-a698-41ce-9e6a-d9611e46fe22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:14.773788 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630fc67-a698-41ce-9e6a-d9611e46fe22 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.785469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1138/2283] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:14.790015 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d2997-e82a-4a58-96c3-9df8fd1825df admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:14.800750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d2997-e82a-4a58-96c3-9df8fd1825df admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:14.807062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a400f2a-7d36-4217-a5db-7f22dce0113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:14.808466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a400f2a-7d36-4217-a5db-7f22dce0113d admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.808752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a400f2a-7d36-4217-a5db-7f22dce0113d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.809033 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a400f2a-7d36-4217-a5db-7f22dce0113d admin admin] PATH_INFO: `/v3/projects/5aa45078426a4ee69a44914030102a31/users/bbec54441c40426698108a08e57ea4ec/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.811217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a400f2a-7d36-4217-a5db-7f22dce0113d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa45078426a4ee69a44914030102a31, user_id=bbec54441c40426698108a08e57ea4ec, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:14.814098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a400f2a-7d36-4217-a5db-7f22dce0113d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:14.825298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1146/2284] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:14 2022] PUT /identity/v3/projects/5aa45078426a4ee69a44914030102a31/users/bbec54441c40426698108a08e57ea4ec/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:14.837402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c12aef-0309-4d40-b22c-c932003ae6fc None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:14.837783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c12aef-0309-4d40-b22c-c932003ae6fc None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:14.837962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c12aef-0309-4d40-b22c-c932003ae6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:14.866848 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-57c12aef-0309-4d40-b22c-c932003ae6fc None None] MFA Rules not processed for user `bbec54441c40426698108a08e57ea4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:14.868082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-57c12aef-0309-4d40-b22c-c932003ae6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:14.914943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:14.940857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1139/2285] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:14.952082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a400f2a-7d36-4217-a5db-7f22dce0113d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:15.015765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a400f2a-7d36-4217-a5db-7f22dce0113d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:15.020085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35419003-a342-43c3-a419-2e4b66fa6626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:15.020695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35419003-a342-43c3-a419-2e4b66fa6626 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:15.020977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35419003-a342-43c3-a419-2e4b66fa6626 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:15.021262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35419003-a342-43c3-a419-2e4b66fa6626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:15.030274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35419003-a342-43c3-a419-2e4b66fa6626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:15.031706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35419003-a342-43c3-a419-2e4b66fa6626 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:15.041488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1147/2286] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:15.129386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c12aef-0309-4d40-b22c-c932003ae6fc None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:15.139199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c12aef-0309-4d40-b22c-c932003ae6fc None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:15.142956 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbf3ba-f04a-4fbd-84d3-9c4ec840c03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:15.143555 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbf3ba-f04a-4fbd-84d3-9c4ec840c03c service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:15.143837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbf3ba-f04a-4fbd-84d3-9c4ec840c03c service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:15.144111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbf3ba-f04a-4fbd-84d3-9c4ec840c03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:15.203729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbf3ba-f04a-4fbd-84d3-9c4ec840c03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:15.205404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbf3ba-f04a-4fbd-84d3-9c4ec840c03c service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:15.217125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1140/2287] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:27:15.457449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316fb3b-6567-4873-8259-aadbcf6b7e7a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:15.457947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316fb3b-6567-4873-8259-aadbcf6b7e7a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:15.458029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316fb3b-6567-4873-8259-aadbcf6b7e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:15.479236 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2316fb3b-6567-4873-8259-aadbcf6b7e7a None None] MFA Rules not processed for user `fc68b2265f7e43cb900b5b7f2f5f02a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:15.480675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2316fb3b-6567-4873-8259-aadbcf6b7e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:15.565658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6b67f-41c3-4418-85a9-f556ae73dd50 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:15.566019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6b67f-41c3-4418-85a9-f556ae73dd50 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:15.566274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6b67f-41c3-4418-85a9-f556ae73dd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:15.576037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1148/2288] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:15.586807 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-fdd6b67f-41c3-4418-85a9-f556ae73dd50 None None] MFA Rules not processed for user `11957165d77e4a2295a21dae4880cf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:15.588041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-fdd6b67f-41c3-4418-85a9-f556ae73dd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:15.648967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1141/2289] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:20.884681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316fb3b-6567-4873-8259-aadbcf6b7e7a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:20.955091 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:20.957157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316fb3b-6567-4873-8259-aadbcf6b7e7a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:20.963495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:20.964168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:20.964690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:20.965144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] PATH_INFO: `/v3/users/d9410dd829084791bb892e1f4e7dfa13` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:20.966403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9410dd829084791bb892e1f4e7dfa13)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:20.968468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:21.053114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9410dd829084791bb892e1f4e7dfa13'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:21.060442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9410dd829084791bb892e1f4e7dfa13'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:21.061369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9410dd829084791bb892e1f4e7dfa13'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:21.079962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9410dd829084791bb892e1f4e7dfa13'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:21.087827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9410dd829084791bb892e1f4e7dfa13'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:21.094551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1149/2290] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:20 2022] DELETE /identity/v3/users/d9410dd829084791bb892e1f4e7dfa13 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:21.099671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89f198-958c-413c-8130-8e9702cf874a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:21.100152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89f198-958c-413c-8130-8e9702cf874a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:21.100240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89f198-958c-413c-8130-8e9702cf874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:21.120388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-7c89f198-958c-413c-8130-8e9702cf874a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:21.121915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7c89f198-958c-413c-8130-8e9702cf874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:21.231089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1142/2291] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:21.263990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:21.266171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:21.342493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ff1cd-a1e1-47b2-ad9a-5e6695084338 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:21.348359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7b357-e9ae-4b92-85b6-1ed500a9a884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:21.349203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7b357-e9ae-4b92-85b6-1ed500a9a884 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:21.349571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7b357-e9ae-4b92-85b6-1ed500a9a884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:21.349952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7b357-e9ae-4b92-85b6-1ed500a9a884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:21.360754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7b357-e9ae-4b92-85b6-1ed500a9a884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:21.362415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7b357-e9ae-4b92-85b6-1ed500a9a884 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:21.372512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1150/2292] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:21.847411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89f198-958c-413c-8130-8e9702cf874a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:21.849114 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7c89f198-958c-413c-8130-8e9702cf874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:21.867947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89f198-958c-413c-8130-8e9702cf874a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:21.873354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:21.874170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:21.874461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:21.875449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] PATH_INFO: `/v3/projects/04346fc87de048898666cf80ebe928e3` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:21.895936 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04346fc87de048898666cf80ebe928e3)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:21.898455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:21.935065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:21.981517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04346fc87de048898666cf80ebe928e3', 'request_id': 'req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:21.990302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04346fc87de048898666cf80ebe928e3', 'request_id': 'req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:21.996779 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04346fc87de048898666cf80ebe928e3', 'request_id': 'req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.011726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] The token cache is being invalidate because project 04346fc87de048898666cf80ebe928e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:22.012096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.012986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.014604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1143/2293] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:21 2022] DELETE /identity/v3/projects/04346fc87de048898666cf80ebe928e3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:22.019217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7b357-e9ae-4b92-85b6-1ed500a9a884 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:22.030744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7b357-e9ae-4b92-85b6-1ed500a9a884 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:22.090709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:22.091417 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:22.091625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:22.091892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] PATH_INFO: `/v3/users/bbec54441c40426698108a08e57ea4ec` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:22.092995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbec54441c40426698108a08e57ea4ec)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:22.094942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:22.121114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:22.151850 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbec54441c40426698108a08e57ea4ec'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.160476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbec54441c40426698108a08e57ea4ec'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.161109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbec54441c40426698108a08e57ea4ec'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.174788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbec54441c40426698108a08e57ea4ec'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.182301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbec54441c40426698108a08e57ea4ec'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.189280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1151/2294] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:22 2022] DELETE /identity/v3/users/bbec54441c40426698108a08e57ea4ec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:22.224222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:22.226083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:22.242960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a7d9-6a43-4228-abcd-3e2ef8939ef9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:22.316882 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:22.317568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:22.317855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:22.318130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] PATH_INFO: `/v3/users/d63e743bfd6542d6a7fc139ec7262ef8` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:22.319266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63e743bfd6542d6a7fc139ec7262ef8)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:22.321337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:22.393124 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63e743bfd6542d6a7fc139ec7262ef8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.404382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63e743bfd6542d6a7fc139ec7262ef8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.405059 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63e743bfd6542d6a7fc139ec7262ef8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.427634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63e743bfd6542d6a7fc139ec7262ef8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.438678 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63e743bfd6542d6a7fc139ec7262ef8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.450053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1144/2295] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:22 2022] DELETE /identity/v3/users/d63e743bfd6542d6a7fc139ec7262ef8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:22.520219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:22.522671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:22.536378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abb683-0e6e-4e14-b07f-d5acf700b19f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:22.603244 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:22.604003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:22.604346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:22.604687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] PATH_INFO: `/v3/projects/5aa45078426a4ee69a44914030102a31` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:22.606238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa45078426a4ee69a44914030102a31)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:22.608247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:22.662080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa45078426a4ee69a44914030102a31', 'request_id': 'req-268d6032-dae9-4eca-96b9-88e0f3a18117'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.669224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa45078426a4ee69a44914030102a31', 'request_id': 'req-268d6032-dae9-4eca-96b9-88e0f3a18117'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.672560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:22.674771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:22.677373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa45078426a4ee69a44914030102a31', 'request_id': 'req-268d6032-dae9-4eca-96b9-88e0f3a18117'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.693689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df530d-357b-4ac6-8f6a-257fae2649ea admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:22.697895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] The token cache is being invalidate because project 5aa45078426a4ee69a44914030102a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:22.698340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.699603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-268d6032-dae9-4eca-96b9-88e0f3a18117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.701146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1152/2296] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:22 2022] DELETE /identity/v3/projects/5aa45078426a4ee69a44914030102a31 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:22.706547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419ba8a-80b6-4ab7-afe2-a1a3810c135f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:22.706827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419ba8a-80b6-4ab7-afe2-a1a3810c135f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:22.707260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419ba8a-80b6-4ab7-afe2-a1a3810c135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:22.728435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-c419ba8a-80b6-4ab7-afe2-a1a3810c135f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:22.729999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c419ba8a-80b6-4ab7-afe2-a1a3810c135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:22.732872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:22.756540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:22.769357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:22.770016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:22.770297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:22.770569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] PATH_INFO: `/v3/projects/53b3d9f3905d4556b7ac1849ee7a5656` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:22.771718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b3d9f3905d4556b7ac1849ee7a5656)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:22.773990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:22.801475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1153/2297] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:22.808303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe38374-2967-41f9-a70a-61b2132fcae6 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:22.808617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe38374-2967-41f9-a70a-61b2132fcae6 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:22.808965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe38374-2967-41f9-a70a-61b2132fcae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:22.828751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-bbe38374-2967-41f9-a70a-61b2132fcae6 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:22.830009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-bbe38374-2967-41f9-a70a-61b2132fcae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:22.831594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b3d9f3905d4556b7ac1849ee7a5656', 'request_id': 'req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.839692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b3d9f3905d4556b7ac1849ee7a5656', 'request_id': 'req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.847653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b3d9f3905d4556b7ac1849ee7a5656', 'request_id': 'req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.859632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] The token cache is being invalidate because project 53b3d9f3905d4556b7ac1849ee7a5656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:22.859925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.860614 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:22.862687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1145/2298] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:22 2022] DELETE /identity/v3/projects/53b3d9f3905d4556b7ac1849ee7a5656 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:22.866860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:22.868209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:22.896923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1154/2299] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:22.901165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe38374-2967-41f9-a70a-61b2132fcae6 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:22.910137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe38374-2967-41f9-a70a-61b2132fcae6 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:22.914951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f2b0d-e557-4417-b0db-a62f4e655440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:22.915714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f2b0d-e557-4417-b0db-a62f4e655440 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:22.915829 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f2b0d-e557-4417-b0db-a62f4e655440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:22.916091 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f2b0d-e557-4417-b0db-a62f4e655440 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:22.916891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f2b0d-e557-4417-b0db-a62f4e655440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:22.917264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f2b0d-e557-4417-b0db-a62f4e655440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:22.918882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f2b0d-e557-4417-b0db-a62f4e655440 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:22.931329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1155/2300] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:27:22.934704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b20688-b01c-4fb7-9ff1-02fffb8f04e3 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:22.936028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f2b0d-e557-4417-b0db-a62f4e655440 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:22.940436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:22.941081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:22.941432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:22.941708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] PATH_INFO: `/v3/users/79fb6c239248469dad196b331ba77cf6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:22.942846 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fb6c239248469dad196b331ba77cf6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:22.944761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:22.946627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f2b0d-e557-4417-b0db-a62f4e655440 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:22.951474 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb4695-0275-4bb9-856c-10e507bbe156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:22.952072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb4695-0275-4bb9-856c-10e507bbe156 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:22.952359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb4695-0275-4bb9-856c-10e507bbe156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:22.952641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb4695-0275-4bb9-856c-10e507bbe156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:22.953294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb4695-0275-4bb9-856c-10e507bbe156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:22.955512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb4695-0275-4bb9-856c-10e507bbe156 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:22.991057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1156/2301] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:22 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:22.992035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb4695-0275-4bb9-856c-10e507bbe156 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:22.998382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fb6c239248469dad196b331ba77cf6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.012513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fb6c239248469dad196b331ba77cf6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.013250 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fb6c239248469dad196b331ba77cf6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.019794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:23.030455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fb6c239248469dad196b331ba77cf6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.038622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fb6c239248469dad196b331ba77cf6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.045470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1146/2302] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:22 2022] DELETE /identity/v3/users/79fb6c239248469dad196b331ba77cf6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:23.074653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb4695-0275-4bb9-856c-10e507bbe156 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.134062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:23.165585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d15c92-675a-49a2-9a44-1d05804560e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.165585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d15c92-675a-49a2-9a44-1d05804560e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.166236 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d15c92-675a-49a2-9a44-1d05804560e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.166937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d15c92-675a-49a2-9a44-1d05804560e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.167313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d15c92-675a-49a2-9a44-1d05804560e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.169420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d15c92-675a-49a2-9a44-1d05804560e1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.198274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1157/2303] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:22 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:23.199563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.201221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:23.216550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51096f5b-9cdb-43b9-9cbb-1b03f263a865 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.226454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177c9ac-13e1-40fa-b046-579a794f3fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.227177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177c9ac-13e1-40fa-b046-579a794f3fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.227579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177c9ac-13e1-40fa-b046-579a794f3fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.227929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177c9ac-13e1-40fa-b046-579a794f3fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.228599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177c9ac-13e1-40fa-b046-579a794f3fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.230963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177c9ac-13e1-40fa-b046-579a794f3fd5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.247653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1147/2304] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:23.249641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d15c92-675a-49a2-9a44-1d05804560e1 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.255546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177c9ac-13e1-40fa-b046-579a794f3fd5 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.258053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d177c9ac-13e1-40fa-b046-579a794f3fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:23.268849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d15c92-675a-49a2-9a44-1d05804560e1 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.276282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f075d70-84f6-4ed6-9e31-aa41c2e5a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.276603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177c9ac-13e1-40fa-b046-579a794f3fd5 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.276962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f075d70-84f6-4ed6-9e31-aa41c2e5a72a admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.277368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f075d70-84f6-4ed6-9e31-aa41c2e5a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.277549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f075d70-84f6-4ed6-9e31-aa41c2e5a72a admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.289446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f075d70-84f6-4ed6-9e31-aa41c2e5a72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.289446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f075d70-84f6-4ed6-9e31-aa41c2e5a72a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.289652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.289652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.289652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.289652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] PATH_INFO: `/v3/projects/2171273aeef54bf997ec84be9d59098a` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.290041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2171273aeef54bf997ec84be9d59098a)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.290041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.291507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1158/2305] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:23.299783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f075d70-84f6-4ed6-9e31-aa41c2e5a72a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.311354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f075d70-84f6-4ed6-9e31-aa41c2e5a72a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.316228 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a494f-4812-4a07-bb65-39936a9328d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.317045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a494f-4812-4a07-bb65-39936a9328d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.317409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a494f-4812-4a07-bb65-39936a9328d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.317687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a494f-4812-4a07-bb65-39936a9328d0 admin admin] PATH_INFO: `/v3/projects/f4f6f700356240479192d9109209f876/users/b0188a24acbb4b59b19e9a2df4e64e8c/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.334218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a494f-4812-4a07-bb65-39936a9328d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f6f700356240479192d9109209f876, user_id=b0188a24acbb4b59b19e9a2df4e64e8c, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.337107 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a494f-4812-4a07-bb65-39936a9328d0 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.341092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2171273aeef54bf997ec84be9d59098a', 'request_id': 'req-bb432536-e496-4713-984d-d9ef68eac8df'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.350275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2171273aeef54bf997ec84be9d59098a', 'request_id': 'req-bb432536-e496-4713-984d-d9ef68eac8df'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.351790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1159/2306] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:23 2022] PUT /identity/v3/projects/f4f6f700356240479192d9109209f876/users/b0188a24acbb4b59b19e9a2df4e64e8c/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:23.356607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2171273aeef54bf997ec84be9d59098a', 'request_id': 'req-bb432536-e496-4713-984d-d9ef68eac8df'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.368138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca568d-bea0-45b7-b344-76feb6fa0af0 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.368413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca568d-bea0-45b7-b344-76feb6fa0af0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.368683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca568d-bea0-45b7-b344-76feb6fa0af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.370426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] The token cache is being invalidate because project 2171273aeef54bf997ec84be9d59098a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:23.370728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.371448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-bb432536-e496-4713-984d-d9ef68eac8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:23.373039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1148/2307] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:23 2022] DELETE /identity/v3/projects/2171273aeef54bf997ec84be9d59098a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:23.378838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b48f-d31b-4708-ae1d-3dbe0e301b6c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.379314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b48f-d31b-4708-ae1d-3dbe0e301b6c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.379652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b48f-d31b-4708-ae1d-3dbe0e301b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.399772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3713b48f-d31b-4708-ae1d-3dbe0e301b6c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:23.400233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-90ca568d-bea0-45b7-b344-76feb6fa0af0 None None] MFA Rules not processed for user `b0188a24acbb4b59b19e9a2df4e64e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:23.400991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3713b48f-d31b-4708-ae1d-3dbe0e301b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:23.401480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-90ca568d-bea0-45b7-b344-76feb6fa0af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:23.463361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1149/2308] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:23.471694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1160/2309] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:23.475200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de039966-37a3-4de5-b7e4-4c0a7e435736 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.475200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de039966-37a3-4de5-b7e4-4c0a7e435736 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.475200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de039966-37a3-4de5-b7e4-4c0a7e435736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.475946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca568d-bea0-45b7-b344-76feb6fa0af0 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.477288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-90ca568d-bea0-45b7-b344-76feb6fa0af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:23.491252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca568d-bea0-45b7-b344-76feb6fa0af0 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.492897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-de039966-37a3-4de5-b7e4-4c0a7e435736 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:23.494134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-de039966-37a3-4de5-b7e4-4c0a7e435736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:23.496084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3372b7-6111-4b21-8acb-2c871bc27b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.496703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3372b7-6111-4b21-8acb-2c871bc27b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.496989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3372b7-6111-4b21-8acb-2c871bc27b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.497307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3372b7-6111-4b21-8acb-2c871bc27b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.497951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3372b7-6111-4b21-8acb-2c871bc27b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.500057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3372b7-6111-4b21-8acb-2c871bc27b16 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.502173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1150/2310] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:23.506596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de039966-37a3-4de5-b7e4-4c0a7e435736 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.515830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de039966-37a3-4de5-b7e4-4c0a7e435736 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.522787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c31fd-48f4-47f6-a1e9-de2fb29268d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.523517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c31fd-48f4-47f6-a1e9-de2fb29268d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.523906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c31fd-48f4-47f6-a1e9-de2fb29268d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.524191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c31fd-48f4-47f6-a1e9-de2fb29268d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.524965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c31fd-48f4-47f6-a1e9-de2fb29268d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:23.525282 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c31fd-48f4-47f6-a1e9-de2fb29268d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.527094 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c31fd-48f4-47f6-a1e9-de2fb29268d9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.534586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1161/2311] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:23 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:23.538774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3372b7-6111-4b21-8acb-2c871bc27b16 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.542223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1151/2312] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:27:23.546258 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c31fd-48f4-47f6-a1e9-de2fb29268d9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.557120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c31fd-48f4-47f6-a1e9-de2fb29268d9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.591091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:23.611286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3372b7-6111-4b21-8acb-2c871bc27b16 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.616783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762173a-26a8-42a7-9044-b9fa5cc7eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.617436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762173a-26a8-42a7-9044-b9fa5cc7eee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.617720 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762173a-26a8-42a7-9044-b9fa5cc7eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.617986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762173a-26a8-42a7-9044-b9fa5cc7eee3 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.618668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762173a-26a8-42a7-9044-b9fa5cc7eee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.620557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762173a-26a8-42a7-9044-b9fa5cc7eee3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.628144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4bbf0-6ef0-466e-af7b-8f48e7aeec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.628772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4bbf0-6ef0-466e-af7b-8f48e7aeec54 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.629052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4bbf0-6ef0-466e-af7b-8f48e7aeec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.629362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4bbf0-6ef0-466e-af7b-8f48e7aeec54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.629995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4bbf0-6ef0-466e-af7b-8f48e7aeec54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.631963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4bbf0-6ef0-466e-af7b-8f48e7aeec54 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.632347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:23.649579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1162/2313] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:23 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:23.653424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762173a-26a8-42a7-9044-b9fa5cc7eee3 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.671249 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762173a-26a8-42a7-9044-b9fa5cc7eee3 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.677990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020d3ce-1571-4215-a18a-1d153cb9937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.678698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020d3ce-1571-4215-a18a-1d153cb9937e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.679026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020d3ce-1571-4215-a18a-1d153cb9937e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.679233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020d3ce-1571-4215-a18a-1d153cb9937e admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.679997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020d3ce-1571-4215-a18a-1d153cb9937e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.681686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020d3ce-1571-4215-a18a-1d153cb9937e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.682425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1152/2314] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:23 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:23.687610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4bbf0-6ef0-466e-af7b-8f48e7aeec54 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.693120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1163/2315] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:23.697667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020d3ce-1571-4215-a18a-1d153cb9937e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.708622 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020d3ce-1571-4215-a18a-1d153cb9937e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.763704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4bbf0-6ef0-466e-af7b-8f48e7aeec54 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.771202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90b2a-546d-41cd-aaeb-16d8bd77ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.772091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90b2a-546d-41cd-aaeb-16d8bd77ae6c admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.772896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90b2a-546d-41cd-aaeb-16d8bd77ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.773357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90b2a-546d-41cd-aaeb-16d8bd77ae6c admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.774008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90b2a-546d-41cd-aaeb-16d8bd77ae6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.777912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90b2a-546d-41cd-aaeb-16d8bd77ae6c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.801919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1153/2316] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:23 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:23.805998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90b2a-546d-41cd-aaeb-16d8bd77ae6c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.810057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24502261-4e80-4168-95fb-91ace3d515a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.810739 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502261-4e80-4168-95fb-91ace3d515a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.811026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502261-4e80-4168-95fb-91ace3d515a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.811306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502261-4e80-4168-95fb-91ace3d515a7 admin admin] PATH_INFO: `/v3/projects/48563db0ea1549d68352d87836e54617/users/1999d5f478aa43818e7ca38955348846/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.816010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90b2a-546d-41cd-aaeb-16d8bd77ae6c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.820682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85262a76-550d-4f4a-95cf-2bf390af1616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.821330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85262a76-550d-4f4a-95cf-2bf390af1616 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.821621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85262a76-550d-4f4a-95cf-2bf390af1616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.821896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85262a76-550d-4f4a-95cf-2bf390af1616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.822688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85262a76-550d-4f4a-95cf-2bf390af1616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.824484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85262a76-550d-4f4a-95cf-2bf390af1616 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.828480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24502261-4e80-4168-95fb-91ace3d515a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48563db0ea1549d68352d87836e54617, user_id=1999d5f478aa43818e7ca38955348846, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.831717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24502261-4e80-4168-95fb-91ace3d515a7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.838520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1154/2317] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:23.839628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85262a76-550d-4f4a-95cf-2bf390af1616 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.850961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85262a76-550d-4f4a-95cf-2bf390af1616 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.855639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1164/2318] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:23 2022] PUT /identity/v3/projects/48563db0ea1549d68352d87836e54617/users/1999d5f478aa43818e7ca38955348846/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:23.859573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24502261-4e80-4168-95fb-91ace3d515a7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.913450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c783b4-6324-467a-8464-301996f098c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.914075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c783b4-6324-467a-8464-301996f098c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.914467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c783b4-6324-467a-8464-301996f098c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.914751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c783b4-6324-467a-8464-301996f098c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.915430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c783b4-6324-467a-8464-301996f098c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.917046 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c783b4-6324-467a-8464-301996f098c0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.923060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24502261-4e80-4168-95fb-91ace3d515a7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.927148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1155/2319] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:23.928214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f341-bc3b-4f6f-8587-527311dc985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.928835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f341-bc3b-4f6f-8587-527311dc985e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.929117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f341-bc3b-4f6f-8587-527311dc985e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.929423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f341-bc3b-4f6f-8587-527311dc985e admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.930071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457f341-bc3b-4f6f-8587-527311dc985e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.931366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c783b4-6324-467a-8464-301996f098c0 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.931665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457f341-bc3b-4f6f-8587-527311dc985e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.942278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c783b4-6324-467a-8464-301996f098c0 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.942537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1165/2320] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:23.948394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f341-bc3b-4f6f-8587-527311dc985e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:23.949468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e54596-256c-49ef-9bf8-1ed376104a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.950300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54596-256c-49ef-9bf8-1ed376104a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.950611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54596-256c-49ef-9bf8-1ed376104a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.950894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54596-256c-49ef-9bf8-1ed376104a39 admin admin] PATH_INFO: `/v3/projects/8bf255feb3da490b8ea0f32d248ea182/users/987c2a14db924c788fef8e06ec0e2a00/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.960050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f341-bc3b-4f6f-8587-527311dc985e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:23.965026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7970ca-23de-4f8f-99b4-5ad2c8d118de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:23.965723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7970ca-23de-4f8f-99b4-5ad2c8d118de admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.966013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7970ca-23de-4f8f-99b4-5ad2c8d118de admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.966294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7970ca-23de-4f8f-99b4-5ad2c8d118de admin admin] PATH_INFO: `/v3/projects/48563db0ea1549d68352d87836e54617/users/1999d5f478aa43818e7ca38955348846/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.967935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e54596-256c-49ef-9bf8-1ed376104a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf255feb3da490b8ea0f32d248ea182, user_id=987c2a14db924c788fef8e06ec0e2a00, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.968212 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7970ca-23de-4f8f-99b4-5ad2c8d118de admin admin] RBAC: Authorizing `identity:create_grant(project_id=48563db0ea1549d68352d87836e54617, user_id=1999d5f478aa43818e7ca38955348846, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:23.970623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e54596-256c-49ef-9bf8-1ed376104a39 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.970928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7970ca-23de-4f8f-99b4-5ad2c8d118de admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:23.982658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1166/2321] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:23 2022] PUT /identity/v3/projects/48563db0ea1549d68352d87836e54617/users/1999d5f478aa43818e7ca38955348846/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:23.984765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1156/2322] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:23 2022] PUT /identity/v3/projects/8bf255feb3da490b8ea0f32d248ea182/users/987c2a14db924c788fef8e06ec0e2a00/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:23.994401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5d48-0055-4b20-979d-00e454049b11 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.994566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f08ef-9cd6-48cc-b52b-d8524717b51d None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:23.994750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5d48-0055-4b20-979d-00e454049b11 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.994887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f08ef-9cd6-48cc-b52b-d8524717b51d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:23.994990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f5d48-0055-4b20-979d-00e454049b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:23.995081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f08ef-9cd6-48cc-b52b-d8524717b51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:24.008598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:24.024867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-2d4f5d48-0055-4b20-979d-00e454049b11 None None] MFA Rules not processed for user `1999d5f478aa43818e7ca38955348846`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:24.026000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-309f08ef-9cd6-48cc-b52b-d8524717b51d None None] MFA Rules not processed for user `987c2a14db924c788fef8e06ec0e2a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:24.026119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2d4f5d48-0055-4b20-979d-00e454049b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:24.027212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-309f08ef-9cd6-48cc-b52b-d8524717b51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:24.065476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:24.093672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1157/2323] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:24.101046 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1167/2324] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:24.106449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f08ef-9cd6-48cc-b52b-d8524717b51d None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:24.108041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-309f08ef-9cd6-48cc-b52b-d8524717b51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:24.112287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f5d48-0055-4b20-979d-00e454049b11 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:24.113811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2d4f5d48-0055-4b20-979d-00e454049b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:24.167165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f08ef-9cd6-48cc-b52b-d8524717b51d None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:24.170852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085517d-1bc9-44d3-9547-f49bf8fc1c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:24.171154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f5d48-0055-4b20-979d-00e454049b11 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:24.171471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085517d-1bc9-44d3-9547-f49bf8fc1c12 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:24.171760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085517d-1bc9-44d3-9547-f49bf8fc1c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:24.172034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085517d-1bc9-44d3-9547-f49bf8fc1c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:24.174781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c783ea-aeec-4b8d-894b-9886d2edd486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:24.175385 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c783ea-aeec-4b8d-894b-9886d2edd486 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:24.175703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c783ea-aeec-4b8d-894b-9886d2edd486 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:24.176106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c783ea-aeec-4b8d-894b-9886d2edd486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:24.180467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085517d-1bc9-44d3-9547-f49bf8fc1c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:24.181938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085517d-1bc9-44d3-9547-f49bf8fc1c12 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:24.191960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1158/2325] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:24.235974 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c783ea-aeec-4b8d-894b-9886d2edd486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:24.237954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c783ea-aeec-4b8d-894b-9886d2edd486 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:24.249802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1168/2326] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:27:26.935396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085517d-1bc9-44d3-9547-f49bf8fc1c12 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:26.968887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c783ea-aeec-4b8d-894b-9886d2edd486 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:27.020833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085517d-1bc9-44d3-9547-f49bf8fc1c12 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:27.028146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:27.029676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.029798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.029996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] PATH_INFO: `/v3/users/987c2a14db924c788fef8e06ec0e2a00` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.031143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=987c2a14db924c788fef8e06ec0e2a00)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:27.034190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:27.050846 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c783ea-aeec-4b8d-894b-9886d2edd486 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:27.056577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:27.057937 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.058240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.059327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] PATH_INFO: `/v3/users/b0188a24acbb4b59b19e9a2df4e64e8c` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.060608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0188a24acbb4b59b19e9a2df4e64e8c)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:27.062667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:27.101824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:27.108708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:27.114284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987c2a14db924c788fef8e06ec0e2a00'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.127404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987c2a14db924c788fef8e06ec0e2a00'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.127687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0188a24acbb4b59b19e9a2df4e64e8c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.128179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987c2a14db924c788fef8e06ec0e2a00'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.137492 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0188a24acbb4b59b19e9a2df4e64e8c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.138396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0188a24acbb4b59b19e9a2df4e64e8c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.144023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987c2a14db924c788fef8e06ec0e2a00'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.153159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-93e4046e-cb9d-45a5-b323-442ea8c60fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987c2a14db924c788fef8e06ec0e2a00'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.153874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0188a24acbb4b59b19e9a2df4e64e8c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.165680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1159/2327] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:26 2022] DELETE /identity/v3/users/987c2a14db924c788fef8e06ec0e2a00 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:27.166969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ee831727-049f-4f6b-b754-92afba3dc574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0188a24acbb4b59b19e9a2df4e64e8c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.167223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9920892-4784-448d-853a-829a19141224 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.167510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9920892-4784-448d-853a-829a19141224 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.167857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9920892-4784-448d-853a-829a19141224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.174165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1169/2328] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:26 2022] DELETE /identity/v3/users/b0188a24acbb4b59b19e9a2df4e64e8c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:27.179218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3212-886d-4b35-a92d-1662483c8e2b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.179489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3212-886d-4b35-a92d-1662483c8e2b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.179767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff3212-886d-4b35-a92d-1662483c8e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.196121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-a9920892-4784-448d-853a-829a19141224 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:27.197845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a9920892-4784-448d-853a-829a19141224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:27.201728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-e0ff3212-886d-4b35-a92d-1662483c8e2b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:27.203139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e0ff3212-886d-4b35-a92d-1662483c8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:27.288167 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1170/2329] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:27.291674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1160/2330] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:27.298331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff3212-886d-4b35-a92d-1662483c8e2b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:27.298776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9920892-4784-448d-853a-829a19141224 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:27.300051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e0ff3212-886d-4b35-a92d-1662483c8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:27.300165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a9920892-4784-448d-853a-829a19141224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:27.365995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9920892-4784-448d-853a-829a19141224 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:27.370031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef104fc-bead-47e1-91b6-d71565fc7999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:27.370655 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef104fc-bead-47e1-91b6-d71565fc7999 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.370966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef104fc-bead-47e1-91b6-d71565fc7999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.371212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef104fc-bead-47e1-91b6-d71565fc7999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.373609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff3212-886d-4b35-a92d-1662483c8e2b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:27.380241 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318227a-cd84-4621-8faa-315c4c215c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:27.381060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318227a-cd84-4621-8faa-315c4c215c11 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.381756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318227a-cd84-4621-8faa-315c4c215c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.382049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318227a-cd84-4621-8faa-315c4c215c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.382629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef104fc-bead-47e1-91b6-d71565fc7999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:27.384626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef104fc-bead-47e1-91b6-d71565fc7999 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:27.393045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318227a-cd84-4621-8faa-315c4c215c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:27.395078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318227a-cd84-4621-8faa-315c4c215c11 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:27.396050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1161/2331] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:27:27.406175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1171/2332] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:27.705259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef104fc-bead-47e1-91b6-d71565fc7999 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:27.708355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-aef104fc-bead-47e1-91b6-d71565fc7999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:27.721445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318227a-cd84-4621-8faa-315c4c215c11 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:27.723918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7318227a-cd84-4621-8faa-315c4c215c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:27.731604 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef104fc-bead-47e1-91b6-d71565fc7999 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:27.739416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:27.740211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.740557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.740924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] PATH_INFO: `/v3/projects/f4f6f700356240479192d9109209f876` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.742311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f6f700356240479192d9109209f876)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:27.744382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318227a-cd84-4621-8faa-315c4c215c11 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:27.744693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:27.750606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:27.751370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.751725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.752072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] PATH_INFO: `/v3/projects/8bf255feb3da490b8ea0f32d248ea182` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.753861 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf255feb3da490b8ea0f32d248ea182)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:27.755887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:27.809674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:27.814428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf255feb3da490b8ea0f32d248ea182', 'request_id': 'req-c681e11d-5945-416c-a2bc-c7a28093191e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.822746 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f6f700356240479192d9109209f876', 'request_id': 'req-35ebc0e5-83d8-43a2-9779-aa60210792ca'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.824262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf255feb3da490b8ea0f32d248ea182', 'request_id': 'req-c681e11d-5945-416c-a2bc-c7a28093191e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.832549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f6f700356240479192d9109209f876', 'request_id': 'req-35ebc0e5-83d8-43a2-9779-aa60210792ca'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.832969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf255feb3da490b8ea0f32d248ea182', 'request_id': 'req-c681e11d-5945-416c-a2bc-c7a28093191e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.834998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:27.844132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f6f700356240479192d9109209f876', 'request_id': 'req-35ebc0e5-83d8-43a2-9779-aa60210792ca'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.851832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] The token cache is being invalidate because project 8bf255feb3da490b8ea0f32d248ea182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:27.852216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.852996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-c681e11d-5945-416c-a2bc-c7a28093191e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.854801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1172/2333] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:27 2022] DELETE /identity/v3/projects/8bf255feb3da490b8ea0f32d248ea182 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:27.859706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff105b-669b-4167-8b21-04e4e4e79a71 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.859997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff105b-669b-4167-8b21-04e4e4e79a71 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.860272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff105b-669b-4167-8b21-04e4e4e79a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.864348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] The token cache is being invalidate because project f4f6f700356240479192d9109209f876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:27.864849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.865744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:27.868415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1162/2334] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:27 2022] DELETE /identity/v3/projects/f4f6f700356240479192d9109209f876 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:27.873356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:27.874821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:27.883184 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-82ff105b-669b-4167-8b21-04e4e4e79a71 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:27.884444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-82ff105b-669b-4167-8b21-04e4e4e79a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:27.964769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1173/2335] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:27.966570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc0e5-83d8-43a2-9779-aa60210792ca admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:27.981278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a37341-1d9a-4ecf-ad97-2bb4f8046617 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.981278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a37341-1d9a-4ecf-ad97-2bb4f8046617 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.981278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a37341-1d9a-4ecf-ad97-2bb4f8046617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.985142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:27.985869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:27.986155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:27.986438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] PATH_INFO: `/v3/users/1999d5f478aa43818e7ca38955348846` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:27.988127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1999d5f478aa43818e7ca38955348846)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:27.990095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:28.004371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a1a37341-1d9a-4ecf-ad97-2bb4f8046617 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:28.005717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a1a37341-1d9a-4ecf-ad97-2bb4f8046617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:28.015593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1174/2336] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:28.020037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a37341-1d9a-4ecf-ad97-2bb4f8046617 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:28.031164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a37341-1d9a-4ecf-ad97-2bb4f8046617 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:28.037804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:28.038643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.039330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.039786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.040574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:28.041027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:28.043238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:28.046352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1999d5f478aa43818e7ca38955348846'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.055058 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1999d5f478aa43818e7ca38955348846'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.055978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1999d5f478aa43818e7ca38955348846'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.058061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1175/2337] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:27:28.062747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:28.064689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:28.073742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1999d5f478aa43818e7ca38955348846'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.081393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d82986-91cb-49a5-ae6b-df869a31bd5e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:28.086751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1999d5f478aa43818e7ca38955348846'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.088974 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81c4b2-4857-42d5-9f89-b24620f5c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:28.089801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81c4b2-4857-42d5-9f89-b24620f5c2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.090190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81c4b2-4857-42d5-9f89-b24620f5c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.090542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81c4b2-4857-42d5-9f89-b24620f5c2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.091266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81c4b2-4857-42d5-9f89-b24620f5c2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:28.098678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81c4b2-4857-42d5-9f89-b24620f5c2b2 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:28.098822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1163/2338] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:27 2022] DELETE /identity/v3/users/1999d5f478aa43818e7ca38955348846 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:28.137285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1176/2339] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:28 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:28.138769 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:28.220090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7e28-db20-4acd-8154-24b15602a9c0 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:28.229020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:28.288218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197386d-2237-4873-8f64-d1bbf99b4a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:28.289061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197386d-2237-4873-8f64-d1bbf99b4a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.289163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197386d-2237-4873-8f64-d1bbf99b4a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.289417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197386d-2237-4873-8f64-d1bbf99b4a51 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.290047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197386d-2237-4873-8f64-d1bbf99b4a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:28.292301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197386d-2237-4873-8f64-d1bbf99b4a51 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:28.324352 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1164/2340] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:28 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:28.325659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81c4b2-4857-42d5-9f89-b24620f5c2b2 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:28.337790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81c4b2-4857-42d5-9f89-b24620f5c2b2 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:28.343487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae963272-5bc6-4fd3-bf87-ec6a0e08dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:28.345287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963272-5bc6-4fd3-bf87-ec6a0e08dcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.345287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963272-5bc6-4fd3-bf87-ec6a0e08dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.345287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae963272-5bc6-4fd3-bf87-ec6a0e08dcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.345587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae963272-5bc6-4fd3-bf87-ec6a0e08dcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:28.347705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae963272-5bc6-4fd3-bf87-ec6a0e08dcf3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:28.361226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1177/2341] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:28.363994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197386d-2237-4873-8f64-d1bbf99b4a51 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:28.374781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197386d-2237-4873-8f64-d1bbf99b4a51 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:28.381869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe89df9-2928-4859-a3c2-aa714ac941cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:28.382802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89df9-2928-4859-a3c2-aa714ac941cb admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.383158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89df9-2928-4859-a3c2-aa714ac941cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.383519 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89df9-2928-4859-a3c2-aa714ac941cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.384357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe89df9-2928-4859-a3c2-aa714ac941cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:28.386137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe89df9-2928-4859-a3c2-aa714ac941cb admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:28.397484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1165/2342] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:28.401668 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae963272-5bc6-4fd3-bf87-ec6a0e08dcf3 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:28.413009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae963272-5bc6-4fd3-bf87-ec6a0e08dcf3 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:28.418082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3a9a7-213e-461d-accb-47e2bdbf861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:28.418868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3a9a7-213e-461d-accb-47e2bdbf861c admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.419219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3a9a7-213e-461d-accb-47e2bdbf861c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.419568 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3a9a7-213e-461d-accb-47e2bdbf861c admin admin] PATH_INFO: `/v3/projects/b1d19dab1697488c9de84cf64905033b/users/cf48e411b3034abb8009aa5b23821b88/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.440466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3a9a7-213e-461d-accb-47e2bdbf861c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d19dab1697488c9de84cf64905033b, user_id=cf48e411b3034abb8009aa5b23821b88, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:28.443263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3a9a7-213e-461d-accb-47e2bdbf861c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:28.458898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1178/2343] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:28 2022] PUT /identity/v3/projects/b1d19dab1697488c9de84cf64905033b/users/cf48e411b3034abb8009aa5b23821b88/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:28.464879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691829d6-ce82-4640-b7b0-aa9ad5af6bed None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.464879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691829d6-ce82-4640-b7b0-aa9ad5af6bed None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.464879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691829d6-ce82-4640-b7b0-aa9ad5af6bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.485775 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-691829d6-ce82-4640-b7b0-aa9ad5af6bed None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:28.487128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-691829d6-ce82-4640-b7b0-aa9ad5af6bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:28.555143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1166/2344] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:28.565269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3a9a7-213e-461d-accb-47e2bdbf861c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:28.569051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f7b3a9a7-213e-461d-accb-47e2bdbf861c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:28.626164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691829d6-ce82-4640-b7b0-aa9ad5af6bed None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:28.627610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-691829d6-ce82-4640-b7b0-aa9ad5af6bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:28.639609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691829d6-ce82-4640-b7b0-aa9ad5af6bed None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:28.639873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3a9a7-213e-461d-accb-47e2bdbf861c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:28.643763 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09c421-40d6-4a19-ae2c-ebd7f903d9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:28.644383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c421-40d6-4a19-ae2c-ebd7f903d9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.644603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:28.644773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c421-40d6-4a19-ae2c-ebd7f903d9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.644936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c421-40d6-4a19-ae2c-ebd7f903d9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.645342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.645624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.645834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] PATH_INFO: `/v3/projects/48563db0ea1549d68352d87836e54617` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.647053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48563db0ea1549d68352d87836e54617)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:28.648980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:28.659267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09c421-40d6-4a19-ae2c-ebd7f903d9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:28.661473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09c421-40d6-4a19-ae2c-ebd7f903d9c2 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:28.667964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:28.685373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1179/2345] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:28.753876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48563db0ea1549d68352d87836e54617', 'request_id': 'req-77db8753-5ce4-40af-be9f-9ce8fcf03060'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.765472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48563db0ea1549d68352d87836e54617', 'request_id': 'req-77db8753-5ce4-40af-be9f-9ce8fcf03060'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.781517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48563db0ea1549d68352d87836e54617', 'request_id': 'req-77db8753-5ce4-40af-be9f-9ce8fcf03060'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.800789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] The token cache is being invalidate because project 48563db0ea1549d68352d87836e54617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:28.802802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.805219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-77db8753-5ce4-40af-be9f-9ce8fcf03060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:28.811118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1167/2346] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:28 2022] DELETE /identity/v3/projects/48563db0ea1549d68352d87836e54617 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:28.816305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876774c-f463-4f33-be03-079077a40ce9 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.816587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876774c-f463-4f33-be03-079077a40ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.816859 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876774c-f463-4f33-be03-079077a40ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.848972 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8876774c-f463-4f33-be03-079077a40ce9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:28.850853 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8876774c-f463-4f33-be03-079077a40ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:28.942240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1180/2347] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:28.943144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb78f4-fa1f-40ee-8b49-c2eec890bb81 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:28.943610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb78f4-fa1f-40ee-8b49-c2eec890bb81 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:28.944043 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb78f4-fa1f-40ee-8b49-c2eec890bb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:28.976136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b1fb78f4-fa1f-40ee-8b49-c2eec890bb81 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:28.977483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b1fb78f4-fa1f-40ee-8b49-c2eec890bb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:28.986820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1168/2348] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:28.991762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876774c-f463-4f33-be03-079077a40ce9 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.002598 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876774c-f463-4f33-be03-079077a40ce9 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.008152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d49e-7175-4d61-812a-0d43bb5135e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.008765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d49e-7175-4d61-812a-0d43bb5135e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.009043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d49e-7175-4d61-812a-0d43bb5135e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.009370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d49e-7175-4d61-812a-0d43bb5135e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.010029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d49e-7175-4d61-812a-0d43bb5135e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:29.010329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d49e-7175-4d61-812a-0d43bb5135e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.011930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d49e-7175-4d61-812a-0d43bb5135e0 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.024673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1181/2349] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:27:29.029396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb78f4-fa1f-40ee-8b49-c2eec890bb81 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.039239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb78f4-fa1f-40ee-8b49-c2eec890bb81 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.044362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed46178-166c-47cf-a30e-89abdc937e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.044983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed46178-166c-47cf-a30e-89abdc937e72 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.045708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed46178-166c-47cf-a30e-89abdc937e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.045708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed46178-166c-47cf-a30e-89abdc937e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.046311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed46178-166c-47cf-a30e-89abdc937e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.048310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed46178-166c-47cf-a30e-89abdc937e72 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.053718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:29.085824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1169/2350] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:29 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:29.090649 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d49e-7175-4d61-812a-0d43bb5135e0 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.101605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d49e-7175-4d61-812a-0d43bb5135e0 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.174387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2582d2-1c95-4bc7-8bbf-a7e6eaf57cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.176023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2582d2-1c95-4bc7-8bbf-a7e6eaf57cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.176453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2582d2-1c95-4bc7-8bbf-a7e6eaf57cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.176927 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2582d2-1c95-4bc7-8bbf-a7e6eaf57cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.177753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2582d2-1c95-4bc7-8bbf-a7e6eaf57cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.179822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2582d2-1c95-4bc7-8bbf-a7e6eaf57cb2 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.205913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1182/2351] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:29 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:29.210134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed46178-166c-47cf-a30e-89abdc937e72 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.220834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed46178-166c-47cf-a30e-89abdc937e72 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.226210 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cf09c-121c-40fc-b69a-69e927a8fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.226830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cf09c-121c-40fc-b69a-69e927a8fe8f admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.227109 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cf09c-121c-40fc-b69a-69e927a8fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.227398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cf09c-121c-40fc-b69a-69e927a8fe8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.228042 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cf09c-121c-40fc-b69a-69e927a8fe8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.229680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cf09c-121c-40fc-b69a-69e927a8fe8f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.240862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1170/2352] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:29.245353 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2582d2-1c95-4bc7-8bbf-a7e6eaf57cb2 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.257734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2582d2-1c95-4bc7-8bbf-a7e6eaf57cb2 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.262766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5574d41-77a0-47c7-91cd-e89d34eeaad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.272791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5574d41-77a0-47c7-91cd-e89d34eeaad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.273591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5574d41-77a0-47c7-91cd-e89d34eeaad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.274075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5574d41-77a0-47c7-91cd-e89d34eeaad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.275204 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5574d41-77a0-47c7-91cd-e89d34eeaad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.277511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5574d41-77a0-47c7-91cd-e89d34eeaad7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.292834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1183/2353] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:29.296818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cf09c-121c-40fc-b69a-69e927a8fe8f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.309461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cf09c-121c-40fc-b69a-69e927a8fe8f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.316039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571b471-47f0-4670-b59b-d32943ad7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.316903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571b471-47f0-4670-b59b-d32943ad7412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.317193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571b471-47f0-4670-b59b-d32943ad7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.317535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571b471-47f0-4670-b59b-d32943ad7412 admin admin] PATH_INFO: `/v3/projects/0f8b47d5d0484c96a34c8091655a6f41/users/5ccdbc136046458583b8dde73ccb9385/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.341689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571b471-47f0-4670-b59b-d32943ad7412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8b47d5d0484c96a34c8091655a6f41, user_id=5ccdbc136046458583b8dde73ccb9385, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.346075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571b471-47f0-4670-b59b-d32943ad7412 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.370847 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1171/2354] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:29 2022] PUT /identity/v3/projects/0f8b47d5d0484c96a34c8091655a6f41/users/5ccdbc136046458583b8dde73ccb9385/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:29.379830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cf252-6514-498f-b2e9-acbd7414645f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.380087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cf252-6514-498f-b2e9-acbd7414645f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.380371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cf252-6514-498f-b2e9-acbd7414645f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.415381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-032cf252-6514-498f-b2e9-acbd7414645f None None] MFA Rules not processed for user `5ccdbc136046458583b8dde73ccb9385`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:29.416613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-032cf252-6514-498f-b2e9-acbd7414645f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:29.481302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:29.491680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1184/2355] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:29.496568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571b471-47f0-4670-b59b-d32943ad7412 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.563799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571b471-47f0-4670-b59b-d32943ad7412 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.570734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c17c69-56dd-4efb-9bff-2da436f17fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.571418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c17c69-56dd-4efb-9bff-2da436f17fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.571701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c17c69-56dd-4efb-9bff-2da436f17fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.571973 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c17c69-56dd-4efb-9bff-2da436f17fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.572644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c17c69-56dd-4efb-9bff-2da436f17fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.574591 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c17c69-56dd-4efb-9bff-2da436f17fa3 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.608456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1172/2356] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:29 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:29.609946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cf252-6514-498f-b2e9-acbd7414645f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.636155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cf252-6514-498f-b2e9-acbd7414645f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.719128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac4331-ce80-4040-8448-386a6919769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.719754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac4331-ce80-4040-8448-386a6919769e admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.720037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac4331-ce80-4040-8448-386a6919769e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.720316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac4331-ce80-4040-8448-386a6919769e admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.720958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac4331-ce80-4040-8448-386a6919769e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.723558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac4331-ce80-4040-8448-386a6919769e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.746235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1185/2357] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:29 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:29.750688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c17c69-56dd-4efb-9bff-2da436f17fa3 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.762159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c17c69-56dd-4efb-9bff-2da436f17fa3 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.766943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbc01e-e329-4b26-914a-f9b2013b33ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.767491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbc01e-e329-4b26-914a-f9b2013b33ad admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.767778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbc01e-e329-4b26-914a-f9b2013b33ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.768060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbc01e-e329-4b26-914a-f9b2013b33ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.769274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbc01e-e329-4b26-914a-f9b2013b33ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.770888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbc01e-e329-4b26-914a-f9b2013b33ad admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.782087 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1173/2358] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:29.786717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac4331-ce80-4040-8448-386a6919769e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.797366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac4331-ce80-4040-8448-386a6919769e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.802860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32bc8f-988b-4761-bd0f-9ebce0dab75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.803482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32bc8f-988b-4761-bd0f-9ebce0dab75f admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.803766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32bc8f-988b-4761-bd0f-9ebce0dab75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.804048 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32bc8f-988b-4761-bd0f-9ebce0dab75f admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.804800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32bc8f-988b-4761-bd0f-9ebce0dab75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.806341 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32bc8f-988b-4761-bd0f-9ebce0dab75f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.818286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1186/2359] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:29.822422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbc01e-e329-4b26-914a-f9b2013b33ad admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:29.834791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbc01e-e329-4b26-914a-f9b2013b33ad admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:29.839660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a0702-0ac3-4f9a-9a8b-852090643aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:29.840419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a0702-0ac3-4f9a-9a8b-852090643aff admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.840825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a0702-0ac3-4f9a-9a8b-852090643aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.841173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a0702-0ac3-4f9a-9a8b-852090643aff admin admin] PATH_INFO: `/v3/projects/43ce13096e124ffbba962c4cec667d81/users/2e7137956b604e15afd305ec2f64a04e/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.860096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a0702-0ac3-4f9a-9a8b-852090643aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ce13096e124ffbba962c4cec667d81, user_id=2e7137956b604e15afd305ec2f64a04e, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:29.863647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a0702-0ac3-4f9a-9a8b-852090643aff admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:29.880120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1174/2360] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:29 2022] PUT /identity/v3/projects/43ce13096e124ffbba962c4cec667d81/users/2e7137956b604e15afd305ec2f64a04e/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:29.889992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476c35d-3ce0-4d31-b66b-e9bf4da01cef None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:29.890287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476c35d-3ce0-4d31-b66b-e9bf4da01cef None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:29.890567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476c35d-3ce0-4d31-b66b-e9bf4da01cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:29.926528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8476c35d-3ce0-4d31-b66b-e9bf4da01cef None None] MFA Rules not processed for user `2e7137956b604e15afd305ec2f64a04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:29.928086 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8476c35d-3ce0-4d31-b66b-e9bf4da01cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:30.027959 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1187/2361] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:30.044128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2c703-8a50-4efe-8c15-6aebd327fb86 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.045726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476c35d-3ce0-4d31-b66b-e9bf4da01cef None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:30.046950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2c703-8a50-4efe-8c15-6aebd327fb86 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.047394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2c703-8a50-4efe-8c15-6aebd327fb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.119739 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-e8b2c703-8a50-4efe-8c15-6aebd327fb86 None None] MFA Rules not processed for user `cf48e411b3034abb8009aa5b23821b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:30.122280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e8b2c703-8a50-4efe-8c15-6aebd327fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:30.192113 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:30.209785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476c35d-3ce0-4d31-b66b-e9bf4da01cef None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:30.218753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4c758-3048-4bea-9450-90bd0c3f4672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:30.219790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4c758-3048-4bea-9450-90bd0c3f4672 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.220211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4c758-3048-4bea-9450-90bd0c3f4672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.220704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4c758-3048-4bea-9450-90bd0c3f4672 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.221462 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4c758-3048-4bea-9450-90bd0c3f4672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:30.223767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4c758-3048-4bea-9450-90bd0c3f4672 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:30.227682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1175/2362] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:30.234856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:30.236187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2c703-8a50-4efe-8c15-6aebd327fb86 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:30.238830 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e8b2c703-8a50-4efe-8c15-6aebd327fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:30.260489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1188/2363] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:30 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:30.264321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4c758-3048-4bea-9450-90bd0c3f4672 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:30.318872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2c703-8a50-4efe-8c15-6aebd327fb86 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:30.347333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4c758-3048-4bea-9450-90bd0c3f4672 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:30.352981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e4686-3156-4d4b-91db-2c400b41ea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:30.353861 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e4686-3156-4d4b-91db-2c400b41ea25 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.353979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e4686-3156-4d4b-91db-2c400b41ea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.354185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e4686-3156-4d4b-91db-2c400b41ea25 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.354876 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e4686-3156-4d4b-91db-2c400b41ea25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:30.357276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e4686-3156-4d4b-91db-2c400b41ea25 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:30.383718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712084f-788d-4615-bf0e-e9c650a2df4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:30.383944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1189/2364] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:30 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:30.384473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712084f-788d-4615-bf0e-e9c650a2df4d service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.384679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712084f-788d-4615-bf0e-e9c650a2df4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.384962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712084f-788d-4615-bf0e-e9c650a2df4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.387662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e4686-3156-4d4b-91db-2c400b41ea25 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:30.397695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e4686-3156-4d4b-91db-2c400b41ea25 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:30.402871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d08dae-ff2a-4b51-bd07-068402efa2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:30.403748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d08dae-ff2a-4b51-bd07-068402efa2ec admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.403748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d08dae-ff2a-4b51-bd07-068402efa2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.404049 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d08dae-ff2a-4b51-bd07-068402efa2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.404700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d08dae-ff2a-4b51-bd07-068402efa2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:30.406388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d08dae-ff2a-4b51-bd07-068402efa2ec admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:30.417601 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1190/2365] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:30.421584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d08dae-ff2a-4b51-bd07-068402efa2ec admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:30.432337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d08dae-ff2a-4b51-bd07-068402efa2ec admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:30.437571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd68ff9-c901-4899-a571-cf4084652d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:30.438408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd68ff9-c901-4899-a571-cf4084652d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.438527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd68ff9-c901-4899-a571-cf4084652d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.438834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd68ff9-c901-4899-a571-cf4084652d85 admin admin] PATH_INFO: `/v3/projects/15af74e29a894f03b6cae33c8d587c35/users/695f5b35a4dc4fbba4355948c67fe253/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.459743 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd68ff9-c901-4899-a571-cf4084652d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15af74e29a894f03b6cae33c8d587c35, user_id=695f5b35a4dc4fbba4355948c67fe253, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:30.462968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd68ff9-c901-4899-a571-cf4084652d85 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:30.465387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712084f-788d-4615-bf0e-e9c650a2df4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:30.467007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712084f-788d-4615-bf0e-e9c650a2df4d service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:30.484503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1191/2366] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:30 2022] PUT /identity/v3/projects/15af74e29a894f03b6cae33c8d587c35/users/695f5b35a4dc4fbba4355948c67fe253/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:30.485567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd68ff9-c901-4899-a571-cf4084652d85 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:30.489572 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1176/2367] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:30.558136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd68ff9-c901-4899-a571-cf4084652d85 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:30.563390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0cd6a-b2b6-489e-b5e1-a0d09daf13a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:30.564032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0cd6a-b2b6-489e-b5e1-a0d09daf13a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.564311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0cd6a-b2b6-489e-b5e1-a0d09daf13a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.564586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0cd6a-b2b6-489e-b5e1-a0d09daf13a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.565272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0cd6a-b2b6-489e-b5e1-a0d09daf13a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:30.567811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0cd6a-b2b6-489e-b5e1-a0d09daf13a7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:30.578398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1192/2368] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:30.582729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712084f-788d-4615-bf0e-e9c650a2df4d service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:30.593954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712084f-788d-4615-bf0e-e9c650a2df4d service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:30.599389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595d80c-d51c-40db-afbb-9ff87ba45ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:30.600106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595d80c-d51c-40db-afbb-9ff87ba45ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.600457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595d80c-d51c-40db-afbb-9ff87ba45ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.600674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595d80c-d51c-40db-afbb-9ff87ba45ba0 admin admin] PATH_INFO: `/v3/projects/15af74e29a894f03b6cae33c8d587c35/users/695f5b35a4dc4fbba4355948c67fe253/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.602716 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595d80c-d51c-40db-afbb-9ff87ba45ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15af74e29a894f03b6cae33c8d587c35, user_id=695f5b35a4dc4fbba4355948c67fe253, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:30.605692 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595d80c-d51c-40db-afbb-9ff87ba45ba0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:30.617188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1177/2369] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:30 2022] PUT /identity/v3/projects/15af74e29a894f03b6cae33c8d587c35/users/695f5b35a4dc4fbba4355948c67fe253/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:30.628367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d084f7-0a06-46a0-9a49-177454d16d33 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.628666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d084f7-0a06-46a0-9a49-177454d16d33 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.628941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d084f7-0a06-46a0-9a49-177454d16d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.665178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-b0d084f7-0a06-46a0-9a49-177454d16d33 None None] MFA Rules not processed for user `695f5b35a4dc4fbba4355948c67fe253`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:30.666435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b0d084f7-0a06-46a0-9a49-177454d16d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:30.704403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:30.757944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1193/2370] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:30.770564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595d80c-d51c-40db-afbb-9ff87ba45ba0 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:30.823492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:30.831476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595d80c-d51c-40db-afbb-9ff87ba45ba0 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:30.835187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb1c12-2400-40db-946b-02f33ada96aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:30.835800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb1c12-2400-40db-946b-02f33ada96aa service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:30.836141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb1c12-2400-40db-946b-02f33ada96aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:30.836415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb1c12-2400-40db-946b-02f33ada96aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:30.894545 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb1c12-2400-40db-946b-02f33ada96aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:30.895998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb1c12-2400-40db-946b-02f33ada96aa service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:30.905033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1178/2371] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:31.868109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94841592-de0a-4bd4-966f-7fbd326a855c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:31.868702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94841592-de0a-4bd4-966f-7fbd326a855c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:31.868702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94841592-de0a-4bd4-966f-7fbd326a855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:31.887473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-94841592-de0a-4bd4-966f-7fbd326a855c None None] MFA Rules not processed for user `cf48e411b3034abb8009aa5b23821b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:31.888654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-94841592-de0a-4bd4-966f-7fbd326a855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:31.944409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1194/2372] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:32.609025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb1c12-2400-40db-946b-02f33ada96aa service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:32.621126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb1c12-2400-40db-946b-02f33ada96aa service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:32.625027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f810a20-2015-4d0d-aaeb-8c330e96f2a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:32.625683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f810a20-2015-4d0d-aaeb-8c330e96f2a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:32.626106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f810a20-2015-4d0d-aaeb-8c330e96f2a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:32.626497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f810a20-2015-4d0d-aaeb-8c330e96f2a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:32.721451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f810a20-2015-4d0d-aaeb-8c330e96f2a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:32.725829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f810a20-2015-4d0d-aaeb-8c330e96f2a1 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:32.737949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1179/2373] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:33.516692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94841592-de0a-4bd4-966f-7fbd326a855c None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:33.526377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94841592-de0a-4bd4-966f-7fbd326a855c None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:33.530218 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750358b-feec-4e48-9071-750c4891f724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:33.530896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750358b-feec-4e48-9071-750c4891f724 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:33.531181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750358b-feec-4e48-9071-750c4891f724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:33.531460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750358b-feec-4e48-9071-750c4891f724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:33.542691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750358b-feec-4e48-9071-750c4891f724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:33.544165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750358b-feec-4e48-9071-750c4891f724 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:33.555297 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1195/2374] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:37.635401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f810a20-2015-4d0d-aaeb-8c330e96f2a1 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:37.742569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f810a20-2015-4d0d-aaeb-8c330e96f2a1 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:37.748265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:37.749631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:37.750188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:37.750660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] PATH_INFO: `/v3/users/5ccdbc136046458583b8dde73ccb9385` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:37.752058 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccdbc136046458583b8dde73ccb9385)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:37.754712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:37.814724 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:37.823431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccdbc136046458583b8dde73ccb9385'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:37.833933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccdbc136046458583b8dde73ccb9385'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:37.834598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccdbc136046458583b8dde73ccb9385'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:37.848217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccdbc136046458583b8dde73ccb9385'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:37.855501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccdbc136046458583b8dde73ccb9385'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:37.865127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1180/2375] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:37 2022] DELETE /identity/v3/users/5ccdbc136046458583b8dde73ccb9385 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:37.869721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db1af5-5cdf-4d16-afef-fc8072c18684 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:37.870268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db1af5-5cdf-4d16-afef-fc8072c18684 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:37.870476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db1af5-5cdf-4d16-afef-fc8072c18684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:37.891394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-10db1af5-5cdf-4d16-afef-fc8072c18684 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:37.893087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-10db1af5-5cdf-4d16-afef-fc8072c18684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:37.965856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1196/2376] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:37.973715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:37.975331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:38.056362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45e44d-b1da-4298-85c1-afb8d67ef5bc admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:38.068537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c35c4-d580-4ec3-8c60-3442205da3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:38.070944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c35c4-d580-4ec3-8c60-3442205da3cb service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:38.071333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c35c4-d580-4ec3-8c60-3442205da3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:38.071979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c35c4-d580-4ec3-8c60-3442205da3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:38.085492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c35c4-d580-4ec3-8c60-3442205da3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:38.087050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c35c4-d580-4ec3-8c60-3442205da3cb service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:38.101737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1181/2377] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:38.673127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db1af5-5cdf-4d16-afef-fc8072c18684 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:38.674782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-10db1af5-5cdf-4d16-afef-fc8072c18684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:38.688530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db1af5-5cdf-4d16-afef-fc8072c18684 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:38.694026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:38.694772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:38.695144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:38.695501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] PATH_INFO: `/v3/projects/0f8b47d5d0484c96a34c8091655a6f41` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:38.696701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f8b47d5d0484c96a34c8091655a6f41)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:38.698986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:38.746375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f8b47d5d0484c96a34c8091655a6f41', 'request_id': 'req-8450e04b-79ae-4504-9707-f12a8c0e9baa'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.748456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:38.754599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f8b47d5d0484c96a34c8091655a6f41', 'request_id': 'req-8450e04b-79ae-4504-9707-f12a8c0e9baa'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.760792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f8b47d5d0484c96a34c8091655a6f41', 'request_id': 'req-8450e04b-79ae-4504-9707-f12a8c0e9baa'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.773093 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] The token cache is being invalidate because project 0f8b47d5d0484c96a34c8091655a6f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:38.773429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.774051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.775523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1197/2378] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:38 2022] DELETE /identity/v3/projects/0f8b47d5d0484c96a34c8091655a6f41 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:38.779569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c35c4-d580-4ec3-8c60-3442205da3cb service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:38.789360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c35c4-d580-4ec3-8c60-3442205da3cb service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:38.845645 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:38.846088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:38.846373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:38.846652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] PATH_INFO: `/v3/users/2e7137956b604e15afd305ec2f64a04e` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:38.848297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7137956b604e15afd305ec2f64a04e)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:38.850272 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:38.897128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7137956b604e15afd305ec2f64a04e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.904582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7137956b604e15afd305ec2f64a04e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.905214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7137956b604e15afd305ec2f64a04e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.912914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:38.919287 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7137956b604e15afd305ec2f64a04e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.927684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7137956b604e15afd305ec2f64a04e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:38.933713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1182/2379] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:38 2022] DELETE /identity/v3/users/2e7137956b604e15afd305ec2f64a04e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:39.218929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:39.220837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:39.235764 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e04b-79ae-4504-9707-f12a8c0e9baa admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:39.300509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:39.301160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:39.301475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:39.301755 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] PATH_INFO: `/v3/projects/43ce13096e124ffbba962c4cec667d81` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:39.302890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ce13096e124ffbba962c4cec667d81)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:39.304802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:39.350526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ce13096e124ffbba962c4cec667d81', 'request_id': 'req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.357329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ce13096e124ffbba962c4cec667d81', 'request_id': 'req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.363751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ce13096e124ffbba962c4cec667d81', 'request_id': 'req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.377333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] The token cache is being invalidate because project 43ce13096e124ffbba962c4cec667d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:39.377620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.378835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.380340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1198/2380] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:39 2022] DELETE /identity/v3/projects/43ce13096e124ffbba962c4cec667d81 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:39.384851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:39.386904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:39.401605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ba768-7900-45e7-ac2b-022e2097b4b7 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:39.461010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:39.461693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:39.461980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:39.462262 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] PATH_INFO: `/v3/users/695f5b35a4dc4fbba4355948c67fe253` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:39.463405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=695f5b35a4dc4fbba4355948c67fe253)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:39.465422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:39.520169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695f5b35a4dc4fbba4355948c67fe253'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.531361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695f5b35a4dc4fbba4355948c67fe253'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.532750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695f5b35a4dc4fbba4355948c67fe253'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.548088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695f5b35a4dc4fbba4355948c67fe253'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.556400 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6a53069b-0c45-4fb0-bbe1-ac67b30d7544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695f5b35a4dc4fbba4355948c67fe253'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:39.563193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1183/2381] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:39 2022] DELETE /identity/v3/users/695f5b35a4dc4fbba4355948c67fe253 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:39.873632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:39.875100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:39.888626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5d431-4d5a-4faa-abef-1aa90d6f2f23 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:39.946495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:39.947138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:39.947424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:39.947695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] PATH_INFO: `/v3/projects/15af74e29a894f03b6cae33c8d587c35` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:39.948809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15af74e29a894f03b6cae33c8d587c35)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:39.950758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:39.962390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:40.000552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15af74e29a894f03b6cae33c8d587c35', 'request_id': 'req-ccec905f-fd40-4bed-a016-c68322936657'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:40.006889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15af74e29a894f03b6cae33c8d587c35', 'request_id': 'req-ccec905f-fd40-4bed-a016-c68322936657'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:40.013472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15af74e29a894f03b6cae33c8d587c35', 'request_id': 'req-ccec905f-fd40-4bed-a016-c68322936657'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:40.027753 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] The token cache is being invalidate because project 15af74e29a894f03b6cae33c8d587c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:40.028230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:40.028863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ccec905f-fd40-4bed-a016-c68322936657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:40.030405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1199/2382] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:39 2022] DELETE /identity/v3/projects/15af74e29a894f03b6cae33c8d587c35 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:40.037138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362c31-e6a9-4a13-860b-00f427e87900 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.037626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362c31-e6a9-4a13-860b-00f427e87900 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.037757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362c31-e6a9-4a13-860b-00f427e87900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.058368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-ca362c31-e6a9-4a13-860b-00f427e87900 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:40.059693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-ca362c31-e6a9-4a13-860b-00f427e87900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:40.119425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:40.129945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1184/2383] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:40.137659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc57fd-e308-4985-a3df-92d30320180b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.137957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc57fd-e308-4985-a3df-92d30320180b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.138243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc57fd-e308-4985-a3df-92d30320180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.162731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-22fc57fd-e308-4985-a3df-92d30320180b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:40.164099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-22fc57fd-e308-4985-a3df-92d30320180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:40.172516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1200/2384] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:40.176871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362c31-e6a9-4a13-860b-00f427e87900 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:40.186761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362c31-e6a9-4a13-860b-00f427e87900 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:40.191422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215675d-2c5d-41e1-9e4f-a0088f1e3490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:40.192021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215675d-2c5d-41e1-9e4f-a0088f1e3490 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.192306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215675d-2c5d-41e1-9e4f-a0088f1e3490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.192577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215675d-2c5d-41e1-9e4f-a0088f1e3490 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.193279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215675d-2c5d-41e1-9e4f-a0088f1e3490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:40.193576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215675d-2c5d-41e1-9e4f-a0088f1e3490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:40.195162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215675d-2c5d-41e1-9e4f-a0088f1e3490 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:40.207179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1185/2385] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:27:40.211640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc57fd-e308-4985-a3df-92d30320180b None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:40.220967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc57fd-e308-4985-a3df-92d30320180b None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:40.226341 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f5f7-7d12-43b5-ab67-ec77be8f6fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:40.226938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f5f7-7d12-43b5-ab67-ec77be8f6fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.227242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f5f7-7d12-43b5-ab67-ec77be8f6fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.227515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f5f7-7d12-43b5-ab67-ec77be8f6fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.228146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159f5f7-7d12-43b5-ab67-ec77be8f6fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:40.230067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159f5f7-7d12-43b5-ab67-ec77be8f6fc8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:40.257422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1201/2386] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:40 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:40.261656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215675d-2c5d-41e1-9e4f-a0088f1e3490 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:40.272379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215675d-2c5d-41e1-9e4f-a0088f1e3490 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:40.330099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50734c2d-f89f-4dda-9d51-e88eb827c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:40.330721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50734c2d-f89f-4dda-9d51-e88eb827c4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.331020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50734c2d-f89f-4dda-9d51-e88eb827c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.331883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50734c2d-f89f-4dda-9d51-e88eb827c4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.332509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50734c2d-f89f-4dda-9d51-e88eb827c4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:40.334444 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50734c2d-f89f-4dda-9d51-e88eb827c4f8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:40.356971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1186/2387] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:40 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:40.361144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f5f7-7d12-43b5-ab67-ec77be8f6fc8 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:40.371844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f5f7-7d12-43b5-ab67-ec77be8f6fc8 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:40.379075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f7974-3cdf-49e7-b4e0-9445c20d13e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:40.379699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f7974-3cdf-49e7-b4e0-9445c20d13e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.379978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f7974-3cdf-49e7-b4e0-9445c20d13e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.380253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f7974-3cdf-49e7-b4e0-9445c20d13e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.380928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f7974-3cdf-49e7-b4e0-9445c20d13e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:40.382615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f7974-3cdf-49e7-b4e0-9445c20d13e6 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:40.396436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1202/2388] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:40.397713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50734c2d-f89f-4dda-9d51-e88eb827c4f8 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:40.407988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50734c2d-f89f-4dda-9d51-e88eb827c4f8 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:40.413228 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d8c8f-b2ac-4bd1-8863-d6eec925853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:40.413874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d8c8f-b2ac-4bd1-8863-d6eec925853b admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.414191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d8c8f-b2ac-4bd1-8863-d6eec925853b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.414434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d8c8f-b2ac-4bd1-8863-d6eec925853b admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.415080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d8c8f-b2ac-4bd1-8863-d6eec925853b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:40.416668 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d8c8f-b2ac-4bd1-8863-d6eec925853b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:40.428045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1187/2389] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:40.432194 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f7974-3cdf-49e7-b4e0-9445c20d13e6 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:40.442553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f7974-3cdf-49e7-b4e0-9445c20d13e6 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:40.447124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714be38-f1bd-4e57-bae7-c2cfa7fb0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:40.447772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714be38-f1bd-4e57-bae7-c2cfa7fb0670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.448055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714be38-f1bd-4e57-bae7-c2cfa7fb0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.448335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714be38-f1bd-4e57-bae7-c2cfa7fb0670 admin admin] PATH_INFO: `/v3/projects/7de19e7c764b4906b888ada3baf09550/users/fba9a997ebbd4145b8b2714cb7e1e3d2/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.463399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714be38-f1bd-4e57-bae7-c2cfa7fb0670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de19e7c764b4906b888ada3baf09550, user_id=fba9a997ebbd4145b8b2714cb7e1e3d2, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:40.466119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714be38-f1bd-4e57-bae7-c2cfa7fb0670 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:40.479391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1203/2390] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:40 2022] PUT /identity/v3/projects/7de19e7c764b4906b888ada3baf09550/users/fba9a997ebbd4145b8b2714cb7e1e3d2/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:40.490005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2a514-3750-45c7-8e5f-a7025f6c29b5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.490276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2a514-3750-45c7-8e5f-a7025f6c29b5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.490550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2a514-3750-45c7-8e5f-a7025f6c29b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.517932 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b2d2a514-3750-45c7-8e5f-a7025f6c29b5 None None] MFA Rules not processed for user `fba9a997ebbd4145b8b2714cb7e1e3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:40.519774 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b2d2a514-3750-45c7-8e5f-a7025f6c29b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:40.583829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1188/2391] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:40.595496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714be38-f1bd-4e57-bae7-c2cfa7fb0670 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:40.597187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0714be38-f1bd-4e57-bae7-c2cfa7fb0670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:40.652710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714be38-f1bd-4e57-bae7-c2cfa7fb0670 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:40.656264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283578c-e635-4a27-b9ba-1350fbd64ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:40.656873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283578c-e635-4a27-b9ba-1350fbd64ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:40.657150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283578c-e635-4a27-b9ba-1350fbd64ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:40.657447 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283578c-e635-4a27-b9ba-1350fbd64ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:40.666344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283578c-e635-4a27-b9ba-1350fbd64ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:40.667799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283578c-e635-4a27-b9ba-1350fbd64ec3 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:40.677183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1204/2392] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:42.927397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101768b9-6098-46f1-96e6-90a402226d50 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:42.927939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101768b9-6098-46f1-96e6-90a402226d50 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:42.928325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101768b9-6098-46f1-96e6-90a402226d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:42.948946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-101768b9-6098-46f1-96e6-90a402226d50 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:42.950330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-101768b9-6098-46f1-96e6-90a402226d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:43.000225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:43.008995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1189/2393] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:27:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:43.064304 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283578c-e635-4a27-b9ba-1350fbd64ec3 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:43.066064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a283578c-e635-4a27-b9ba-1350fbd64ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:43.113726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:43.152750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283578c-e635-4a27-b9ba-1350fbd64ec3 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:43.157849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedfe48-e937-49e1-9659-0db8c753c8e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:43.158461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedfe48-e937-49e1-9659-0db8c753c8e0 service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:43.158740 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedfe48-e937-49e1-9659-0db8c753c8e0 service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:43.159013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedfe48-e937-49e1-9659-0db8c753c8e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:43.170623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedfe48-e937-49e1-9659-0db8c753c8e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:43.172083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedfe48-e937-49e1-9659-0db8c753c8e0 service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:43.183735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1205/2394] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:27:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 18:27:43.933309 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6468e-e814-48eb-8b6e-0eaae95b94aa None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:43.933928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6468e-e814-48eb-8b6e-0eaae95b94aa None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:43.934192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6468e-e814-48eb-8b6e-0eaae95b94aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:43.956425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-a0b6468e-e814-48eb-8b6e-0eaae95b94aa None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:43.957686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a0b6468e-e814-48eb-8b6e-0eaae95b94aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:43.965528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1190/2395] 10.222.0.61 () {58 vars in 967 bytes} [Thu Sep 22 18:27:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:43.979560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedfe48-e937-49e1-9659-0db8c753c8e0 service swift] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:43.991942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedfe48-e937-49e1-9659-0db8c753c8e0 service swift] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:43.999455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92093662-4c40-4a42-a34b-7bb31033e10a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:44.000539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92093662-4c40-4a42-a34b-7bb31033e10a service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:44.000539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92093662-4c40-4a42-a34b-7bb31033e10a service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:44.000776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92093662-4c40-4a42-a34b-7bb31033e10a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:44.010612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92093662-4c40-4a42-a34b-7bb31033e10a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:44.012196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92093662-4c40-4a42-a34b-7bb31033e10a service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:44.024128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1206/2396] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:27:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:27:44.345020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737fda7-7993-4a3c-8209-4a5beac88b27 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:44.345782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737fda7-7993-4a3c-8209-4a5beac88b27 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:44.346263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737fda7-7993-4a3c-8209-4a5beac88b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:44.366555 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5737fda7-7993-4a3c-8209-4a5beac88b27 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:44.367765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5737fda7-7993-4a3c-8209-4a5beac88b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:44.375479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1191/2397] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:27:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:44.391809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92093662-4c40-4a42-a34b-7bb31033e10a service swift] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:44.406555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92093662-4c40-4a42-a34b-7bb31033e10a service swift] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:44.414123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8bc84-f095-4a94-8290-9936c5bdb8c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:44.415370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8bc84-f095-4a94-8290-9936c5bdb8c6 service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:44.415811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8bc84-f095-4a94-8290-9936c5bdb8c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:44.416310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8bc84-f095-4a94-8290-9936c5bdb8c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:44.426178 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8bc84-f095-4a94-8290-9936c5bdb8c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:44.428268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8bc84-f095-4a94-8290-9936c5bdb8c6 service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:44.437727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1207/2398] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:27:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:27:44.873640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47917-d54e-4108-93e3-fb5e799620d3 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:44.874188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47917-d54e-4108-93e3-fb5e799620d3 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:44.874626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47917-d54e-4108-93e3-fb5e799620d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:44.905259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5cd47917-d54e-4108-93e3-fb5e799620d3 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:44.909055 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5cd47917-d54e-4108-93e3-fb5e799620d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:44.928616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1192/2399] 10.222.0.61 () {58 vars in 967 bytes} [Thu Sep 22 18:27:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:44.944092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8bc84-f095-4a94-8290-9936c5bdb8c6 service swift] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:44.959695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8bc84-f095-4a94-8290-9936c5bdb8c6 service swift] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:44.965932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44b95-fbb8-49f7-b568-1ddd8977bb64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:44.966558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44b95-fbb8-49f7-b568-1ddd8977bb64 service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:44.966837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44b95-fbb8-49f7-b568-1ddd8977bb64 service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:44.967106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44b95-fbb8-49f7-b568-1ddd8977bb64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:44.977014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d44b95-fbb8-49f7-b568-1ddd8977bb64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:44.978758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d44b95-fbb8-49f7-b568-1ddd8977bb64 service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:44.988997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1208/2400] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:27:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:27:45.114717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fcc19-b766-4b9d-9094-945132de13b0 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:45.115204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fcc19-b766-4b9d-9094-945132de13b0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:45.115302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fcc19-b766-4b9d-9094-945132de13b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:45.135510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-458fcc19-b766-4b9d-9094-945132de13b0 None None] MFA Rules not processed for user `36d7b059ff874d0db44ceecb2f95830c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:45.136721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-458fcc19-b766-4b9d-9094-945132de13b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:45.197739 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1193/2401] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:46.011402 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44b95-fbb8-49f7-b568-1ddd8977bb64 service swift] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:46.122143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44b95-fbb8-49f7-b568-1ddd8977bb64 service swift] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:46.128708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:46.129981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:46.130613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:46.131354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] PATH_INFO: `/v3/users/fba9a997ebbd4145b8b2714cb7e1e3d2` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:46.133611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba9a997ebbd4145b8b2714cb7e1e3d2)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:46.136161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:46.211430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba9a997ebbd4145b8b2714cb7e1e3d2'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.226494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba9a997ebbd4145b8b2714cb7e1e3d2'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.227234 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba9a997ebbd4145b8b2714cb7e1e3d2'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.242962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba9a997ebbd4145b8b2714cb7e1e3d2'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.250651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba9a997ebbd4145b8b2714cb7e1e3d2'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.257625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1209/2402] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:46 2022] DELETE /identity/v3/users/fba9a997ebbd4145b8b2714cb7e1e3d2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:46.262687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcab62e-be10-40c7-a9a3-d13e7d093d0d None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:46.263164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcab62e-be10-40c7-a9a3-d13e7d093d0d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:46.263449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcab62e-be10-40c7-a9a3-d13e7d093d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:46.284922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5fcab62e-be10-40c7-a9a3-d13e7d093d0d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:46.286189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5fcab62e-be10-40c7-a9a3-d13e7d093d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:46.361212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1194/2403] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:46.372078 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:46.373640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:46.387495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:46.446039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e093e-2ed6-46d2-91ee-2162363e6cc7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:46.450196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3af4c-2569-4ed4-b4c7-41ebcdd7f0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:46.450805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3af4c-2569-4ed4-b4c7-41ebcdd7f0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:46.450974 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3af4c-2569-4ed4-b4c7-41ebcdd7f0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:46.451251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3af4c-2569-4ed4-b4c7-41ebcdd7f0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:46.461287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3af4c-2569-4ed4-b4c7-41ebcdd7f0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:46.462821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3af4c-2569-4ed4-b4c7-41ebcdd7f0d9 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:46.473505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1210/2404] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:27:46.807302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcab62e-be10-40c7-a9a3-d13e7d093d0d None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:46.811859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5fcab62e-be10-40c7-a9a3-d13e7d093d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:46.826689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcab62e-be10-40c7-a9a3-d13e7d093d0d None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:46.832922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:46.833686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:46.833966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:46.834603 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] PATH_INFO: `/v3/projects/7de19e7c764b4906b888ada3baf09550` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:46.835684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de19e7c764b4906b888ada3baf09550)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:46.837895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:46.895870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de19e7c764b4906b888ada3baf09550', 'request_id': 'req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.904605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de19e7c764b4906b888ada3baf09550', 'request_id': 'req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.911844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de19e7c764b4906b888ada3baf09550', 'request_id': 'req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.924364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] The token cache is being invalidate because project 7de19e7c764b4906b888ada3baf09550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:46.924687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.925534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-ee8d9cdc-f6ad-4c4b-a9f0-c741fda79857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:46.927342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1195/2405] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:46 2022] DELETE /identity/v3/projects/7de19e7c764b4906b888ada3baf09550 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:46.933389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2f8e-1171-4a66-8629-bfb19fa226c5 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:46.933828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2f8e-1171-4a66-8629-bfb19fa226c5 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:46.934202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2f8e-1171-4a66-8629-bfb19fa226c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:46.955067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1feb2f8e-1171-4a66-8629-bfb19fa226c5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:46.956918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1feb2f8e-1171-4a66-8629-bfb19fa226c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:47.020943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1211/2406] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:47.030590 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8d9f3-42ef-45c1-aca7-c6d56a323667 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.030885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8d9f3-42ef-45c1-aca7-c6d56a323667 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.031266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8d9f3-42ef-45c1-aca7-c6d56a323667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.052117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d5c8d9f3-42ef-45c1-aca7-c6d56a323667 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:47.059690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d5c8d9f3-42ef-45c1-aca7-c6d56a323667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:47.075751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1196/2407] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:47.077183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb2f8e-1171-4a66-8629-bfb19fa226c5 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:47.088899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb2f8e-1171-4a66-8629-bfb19fa226c5 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:47.098803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851926e0-559a-4ab3-ab05-9733c37497ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:47.099798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851926e0-559a-4ab3-ab05-9733c37497ad admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.100545 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851926e0-559a-4ab3-ab05-9733c37497ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.101002 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851926e0-559a-4ab3-ab05-9733c37497ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.102210 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851926e0-559a-4ab3-ab05-9733c37497ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:27:47.102723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851926e0-559a-4ab3-ab05-9733c37497ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:47.105293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851926e0-559a-4ab3-ab05-9733c37497ad admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:47.119298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1212/2408] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:27:47.123176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8d9f3-42ef-45c1-aca7-c6d56a323667 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:47.127768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:47.134995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8d9f3-42ef-45c1-aca7-c6d56a323667 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:47.140870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0713b-8d85-457f-beef-4c3cd4982fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:47.141506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0713b-8d85-457f-beef-4c3cd4982fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.141789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0713b-8d85-457f-beef-4c3cd4982fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.142062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0713b-8d85-457f-beef-4c3cd4982fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.142700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0713b-8d85-457f-beef-4c3cd4982fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:47.145419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0713b-8d85-457f-beef-4c3cd4982fb7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:47.174024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1197/2409] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:47 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:47.178374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851926e0-559a-4ab3-ab05-9733c37497ad admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:47.189145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851926e0-559a-4ab3-ab05-9733c37497ad admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:47.266335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0713b-8d85-457f-beef-4c3cd4982fb7 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:47.270438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-99e0713b-8d85-457f-beef-4c3cd4982fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:47.273574 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaeaee-5e29-4e8d-b8e6-128821163c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:47.275044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaeaee-5e29-4e8d-b8e6-128821163c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.275802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaeaee-5e29-4e8d-b8e6-128821163c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.276594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaeaee-5e29-4e8d-b8e6-128821163c4d admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.277881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaeaee-5e29-4e8d-b8e6-128821163c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:47.281681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaeaee-5e29-4e8d-b8e6-128821163c4d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:47.298771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0713b-8d85-457f-beef-4c3cd4982fb7 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:47.308364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:47.309861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.310443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.310893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] PATH_INFO: `/v3/users/fc68b2265f7e43cb900b5b7f2f5f02a0` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.313049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc68b2265f7e43cb900b5b7f2f5f02a0)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:47.315084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1213/2410] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:47 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:27:47.316865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:47.319463 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaeaee-5e29-4e8d-b8e6-128821163c4d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:47.330619 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaeaee-5e29-4e8d-b8e6-128821163c4d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:47.341890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e6856-1737-46bf-af1e-e586eec83dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:47.342762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6856-1737-46bf-af1e-e586eec83dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.343045 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6856-1737-46bf-af1e-e586eec83dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.343322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6856-1737-46bf-af1e-e586eec83dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.344131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e6856-1737-46bf-af1e-e586eec83dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:47.345888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e6856-1737-46bf-af1e-e586eec83dfd admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:47.357528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1214/2411] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:47.361692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e6856-1737-46bf-af1e-e586eec83dfd admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:47.371828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e6856-1737-46bf-af1e-e586eec83dfd admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:47.373829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc68b2265f7e43cb900b5b7f2f5f02a0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:47.376515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b252a-adbb-49b5-9097-a702c73f36c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:47.377555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b252a-adbb-49b5-9097-a702c73f36c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.377555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b252a-adbb-49b5-9097-a702c73f36c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.377766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b252a-adbb-49b5-9097-a702c73f36c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.378947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b252a-adbb-49b5-9097-a702c73f36c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:47.380964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b252a-adbb-49b5-9097-a702c73f36c5 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:47.386425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc68b2265f7e43cb900b5b7f2f5f02a0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:47.387708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc68b2265f7e43cb900b5b7f2f5f02a0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:47.393455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1215/2412] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:27:47.398333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b252a-adbb-49b5-9097-a702c73f36c5 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:47.400472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b65b252a-adbb-49b5-9097-a702c73f36c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:47.404313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc68b2265f7e43cb900b5b7f2f5f02a0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:47.411689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-19d233d8-7605-4a51-b70b-16a365cf8132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc68b2265f7e43cb900b5b7f2f5f02a0'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:47.414836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b252a-adbb-49b5-9097-a702c73f36c5 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:47.417972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1198/2413] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:27:47 2022] DELETE /identity/v3/users/fc68b2265f7e43cb900b5b7f2f5f02a0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:47.422354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210580-ddc9-4eb4-b85b-e1ab3c73e0f9 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.422684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8890-5dc6-4577-b12d-0cdab78e513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:47.422832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210580-ddc9-4eb4-b85b-e1ab3c73e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.422927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16210580-ddc9-4eb4-b85b-e1ab3c73e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.423509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8890-5dc6-4577-b12d-0cdab78e513a admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.423862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8890-5dc6-4577-b12d-0cdab78e513a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.424209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8890-5dc6-4577-b12d-0cdab78e513a admin admin] PATH_INFO: `/v3/projects/996e900bf9874f31b00a3a0f53630e8d/users/bc4e92db52d54f6ea2dc2184760c6500/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.426863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:47.442314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-16210580-ddc9-4eb4-b85b-e1ab3c73e0f9 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:47.443543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-16210580-ddc9-4eb4-b85b-e1ab3c73e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:47.444155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c8890-5dc6-4577-b12d-0cdab78e513a admin admin] RBAC: Authorizing `identity:create_grant(project_id=996e900bf9874f31b00a3a0f53630e8d, user_id=bc4e92db52d54f6ea2dc2184760c6500, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:47.447276 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c8890-5dc6-4577-b12d-0cdab78e513a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:47.464371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1216/2414] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:47 2022] PUT /identity/v3/projects/996e900bf9874f31b00a3a0f53630e8d/users/bc4e92db52d54f6ea2dc2184760c6500/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:27:47.469715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6d6c0-2924-4f67-88d5-867570cce258 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.470457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6d6c0-2924-4f67-88d5-867570cce258 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.470913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6d6c0-2924-4f67-88d5-867570cce258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.496003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d9a6d6c0-2924-4f67-88d5-867570cce258 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:47.497262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d9a6d6c0-2924-4f67-88d5-867570cce258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:47.526580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1199/2415] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:27:47.537467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210580-ddc9-4eb4-b85b-e1ab3c73e0f9 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:47.538979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-16210580-ddc9-4eb4-b85b-e1ab3c73e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:47.567365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1217/2416] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:47.575069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6d6c0-2924-4f67-88d5-867570cce258 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:47.577365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d9a6d6c0-2924-4f67-88d5-867570cce258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:47.624157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16210580-ddc9-4eb4-b85b-e1ab3c73e0f9 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:47.633368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:47.648928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6d6c0-2924-4f67-88d5-867570cce258 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:47.654293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e91d92-92ac-4a14-9f40-78c934900cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:47.654988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91d92-92ac-4a14-9f40-78c934900cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.655213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91d92-92ac-4a14-9f40-78c934900cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.655490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91d92-92ac-4a14-9f40-78c934900cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.683155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e91d92-92ac-4a14-9f40-78c934900cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:47.685332 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e91d92-92ac-4a14-9f40-78c934900cd6 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:47.697211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1218/2417] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:27:47.702992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece9933-4cea-4fbc-a8be-23de1f7486de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:47.703708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece9933-4cea-4fbc-a8be-23de1f7486de service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.703996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece9933-4cea-4fbc-a8be-23de1f7486de service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.704407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece9933-4cea-4fbc-a8be-23de1f7486de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.714632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece9933-4cea-4fbc-a8be-23de1f7486de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:47.716090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece9933-4cea-4fbc-a8be-23de1f7486de service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:47.728307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1200/2418] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:27:47.820424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56036a82-59bd-40f8-b465-c87876729137 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:47.820783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56036a82-59bd-40f8-b465-c87876729137 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:47.820986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56036a82-59bd-40f8-b465-c87876729137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:47.841588 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-56036a82-59bd-40f8-b465-c87876729137 None None] MFA Rules not processed for user `11957165d77e4a2295a21dae4880cf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:47.842912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-56036a82-59bd-40f8-b465-c87876729137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:47.904736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1219/2419] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:48.278554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece9933-4cea-4fbc-a8be-23de1f7486de service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:48.281909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2ece9933-4cea-4fbc-a8be-23de1f7486de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:48.309720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece9933-4cea-4fbc-a8be-23de1f7486de service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:48.338235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:48.339067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:48.339647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:48.340120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] PATH_INFO: `/v3/projects/8a178debf57d4ddebedcad5574a6ccb4` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:48.342373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a178debf57d4ddebedcad5574a6ccb4)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:48.345943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:48.479295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a178debf57d4ddebedcad5574a6ccb4', 'request_id': 'req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:48.495496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a178debf57d4ddebedcad5574a6ccb4', 'request_id': 'req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:48.509368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a178debf57d4ddebedcad5574a6ccb4', 'request_id': 'req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:48.529112 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] The token cache is being invalidate because project 8a178debf57d4ddebedcad5574a6ccb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:27:48.530634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:48.531553 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:27:48.533642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1201/2420] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:27:48 2022] DELETE /identity/v3/projects/8a178debf57d4ddebedcad5574a6ccb4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:54.091079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752bc8f-6e22-4df9-a5a4-7b9b8dc69d4f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:54.091868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752bc8f-6e22-4df9-a5a4-7b9b8dc69d4f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:54.092328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752bc8f-6e22-4df9-a5a4-7b9b8dc69d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:54.181095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a752bc8f-6e22-4df9-a5a4-7b9b8dc69d4f None None] MFA Rules not processed for user `bc4e92db52d54f6ea2dc2184760c6500`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:27:54.189436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a752bc8f-6e22-4df9-a5a4-7b9b8dc69d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:54.222692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:54.314586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1220/2421] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:27:54.319658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:54.321385 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:27:54.447133 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2523f-2b1f-4e22-9f3c-ce4e41a1de84 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:54.455161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af796b86-9050-4809-873e-bff0ac135d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:54.455827 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796b86-9050-4809-873e-bff0ac135d79 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:54.456122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796b86-9050-4809-873e-bff0ac135d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:54.456457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796b86-9050-4809-873e-bff0ac135d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:54.457302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af796b86-9050-4809-873e-bff0ac135d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:54.459316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af796b86-9050-4809-873e-bff0ac135d79 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:54.496914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1202/2422] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:27:54 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:54.500754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752bc8f-6e22-4df9-a5a4-7b9b8dc69d4f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:54.513475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752bc8f-6e22-4df9-a5a4-7b9b8dc69d4f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:54.583041 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cad25-f2b2-471f-81ab-0ca112692409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:54.583706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cad25-f2b2-471f-81ab-0ca112692409 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:54.583993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cad25-f2b2-471f-81ab-0ca112692409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:54.584261 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cad25-f2b2-471f-81ab-0ca112692409 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:54.585026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cad25-f2b2-471f-81ab-0ca112692409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:54.587165 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cad25-f2b2-471f-81ab-0ca112692409 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:54.614202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1221/2423] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:27:54 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:27:54.617852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af796b86-9050-4809-873e-bff0ac135d79 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:54.630909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af796b86-9050-4809-873e-bff0ac135d79 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:54.636813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0911a63-78d7-49ae-a55d-6a34f30d22b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:54.637476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911a63-78d7-49ae-a55d-6a34f30d22b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:54.637812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911a63-78d7-49ae-a55d-6a34f30d22b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:54.638086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911a63-78d7-49ae-a55d-6a34f30d22b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:54.638733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0911a63-78d7-49ae-a55d-6a34f30d22b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:54.640920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0911a63-78d7-49ae-a55d-6a34f30d22b0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:54.661289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1203/2424] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:54.665387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cad25-f2b2-471f-81ab-0ca112692409 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:54.680328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cad25-f2b2-471f-81ab-0ca112692409 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:54.686359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361bf77-a0c0-42d0-891b-3347bd8b7287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:54.687053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361bf77-a0c0-42d0-891b-3347bd8b7287 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:54.687399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361bf77-a0c0-42d0-891b-3347bd8b7287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:54.687606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361bf77-a0c0-42d0-891b-3347bd8b7287 admin admin] PATH_INFO: `/v3/projects/7e13202c2fb846589ddfcc6ccb09d95e/users/0375d31fc2b44d42888dbbbabdcbe5b3/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:54.704992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361bf77-a0c0-42d0-891b-3347bd8b7287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e13202c2fb846589ddfcc6ccb09d95e, user_id=0375d31fc2b44d42888dbbbabdcbe5b3, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:54.707846 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361bf77-a0c0-42d0-891b-3347bd8b7287 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:54.723297 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1222/2425] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:54 2022] PUT /identity/v3/projects/7e13202c2fb846589ddfcc6ccb09d95e/users/0375d31fc2b44d42888dbbbabdcbe5b3/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:27:54.727096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0911a63-78d7-49ae-a55d-6a34f30d22b0 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:54.738480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0911a63-78d7-49ae-a55d-6a34f30d22b0 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:54.743448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:27:54.802420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad746fe-ceee-4435-9b7e-4ab93b8b349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:54.803058 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad746fe-ceee-4435-9b7e-4ab93b8b349b admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:54.803337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad746fe-ceee-4435-9b7e-4ab93b8b349b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:54.803610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad746fe-ceee-4435-9b7e-4ab93b8b349b admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:54.804245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad746fe-ceee-4435-9b7e-4ab93b8b349b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:54.805890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad746fe-ceee-4435-9b7e-4ab93b8b349b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:54.816158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1204/2426] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:27:54.820540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361bf77-a0c0-42d0-891b-3347bd8b7287 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:27:54.831456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361bf77-a0c0-42d0-891b-3347bd8b7287 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:27:54.836456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b14d-e029-4459-ab10-5d73e441ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:27:54.837171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b14d-e029-4459-ab10-5d73e441ef5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:27:54.838030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b14d-e029-4459-ab10-5d73e441ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:27:54.838030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b14d-e029-4459-ab10-5d73e441ef5c admin admin] PATH_INFO: `/v3/projects/7e13202c2fb846589ddfcc6ccb09d95e/users/0375d31fc2b44d42888dbbbabdcbe5b3/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:27:54.840030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8b14d-e029-4459-ab10-5d73e441ef5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e13202c2fb846589ddfcc6ccb09d95e, user_id=0375d31fc2b44d42888dbbbabdcbe5b3, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:27:54.843168 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8b14d-e029-4459-ab10-5d73e441ef5c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:27:54.856055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1223/2427] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:27:54 2022] PUT /identity/v3/projects/7e13202c2fb846589ddfcc6ccb09d95e/users/0375d31fc2b44d42888dbbbabdcbe5b3/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:28:01.078580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdd29d-3ab7-4a52-91df-f421689d1332 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:01.079095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdd29d-3ab7-4a52-91df-f421689d1332 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:01.079191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdd29d-3ab7-4a52-91df-f421689d1332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:01.110163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-fcbdd29d-3ab7-4a52-91df-f421689d1332 None None] MFA Rules not processed for user `0375d31fc2b44d42888dbbbabdcbe5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:01.111393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-fcbdd29d-3ab7-4a52-91df-f421689d1332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:01.183988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1205/2428] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:28:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:01.196433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b14d-e029-4459-ab10-5d73e441ef5c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:01.198251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1ab8b14d-e029-4459-ab10-5d73e441ef5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:01.264670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b14d-e029-4459-ab10-5d73e441ef5c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:01.268438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dab626-e952-4a7a-a3c2-21c8497ebf7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab45d09f8724d9ca5b6fb1fa050fdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:01.269657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dab626-e952-4a7a-a3c2-21c8497ebf7e service glance] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:01.269948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dab626-e952-4a7a-a3c2-21c8497ebf7e service glance] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:01.270235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dab626-e952-4a7a-a3c2-21c8497ebf7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:01.314327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:28:01.350973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dab626-e952-4a7a-a3c2-21c8497ebf7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:01.352597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dab626-e952-4a7a-a3c2-21c8497ebf7e service glance] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:01.362832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1224/2429] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:28:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:28:01.499368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7688b-fa73-420f-903b-296d01913f2e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:01.499662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7688b-fa73-420f-903b-296d01913f2e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:01.499974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7688b-fa73-420f-903b-296d01913f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:01.521535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-7ff7688b-fa73-420f-903b-296d01913f2e None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:01.522761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7ff7688b-fa73-420f-903b-296d01913f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:01.593846 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1206/2430] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:28:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:01.606341 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dab626-e952-4a7a-a3c2-21c8497ebf7e service glance] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:01.607766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e3dab626-e952-4a7a-a3c2-21c8497ebf7e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:01.686687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dab626-e952-4a7a-a3c2-21c8497ebf7e service glance] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:01.692332 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05485e62-441e-47a9-8bb4-0c1f4ee7c311 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:01.692949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05485e62-441e-47a9-8bb4-0c1f4ee7c311 service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:01.693230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05485e62-441e-47a9-8bb4-0c1f4ee7c311 service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:01.693531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05485e62-441e-47a9-8bb4-0c1f4ee7c311 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:01.701852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05485e62-441e-47a9-8bb4-0c1f4ee7c311 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:01.703380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05485e62-441e-47a9-8bb4-0c1f4ee7c311 service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:01.712232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1225/2431] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:28:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:28:11.586856 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=84 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:28:11.708893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=47 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:28:12.997141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5c28-99d9-4218-81da-0647ede5c763 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:12.997824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5c28-99d9-4218-81da-0647ede5c763 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:12.997824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5c28-99d9-4218-81da-0647ede5c763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:13.016307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-784e5c28-99d9-4218-81da-0647ede5c763 None None] MFA Rules not processed for user `bc4e92db52d54f6ea2dc2184760c6500`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:13.017556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-784e5c28-99d9-4218-81da-0647ede5c763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:13.025068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1207/2432] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:28:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:15.917103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1cc41-6511-4179-8abd-1252ff112741 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:15.917593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1cc41-6511-4179-8abd-1252ff112741 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:15.917723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1cc41-6511-4179-8abd-1252ff112741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:15.942150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-7fc1cc41-6511-4179-8abd-1252ff112741 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:15.944155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7fc1cc41-6511-4179-8abd-1252ff112741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:15.953584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1226/2433] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:28:15.966868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e5c28-99d9-4218-81da-0647ede5c763 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:15.979315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e5c28-99d9-4218-81da-0647ede5c763 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:15.985277 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d1f77-cadc-4104-b9d3-da11887a867d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:15.986002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d1f77-cadc-4104-b9d3-da11887a867d service swift] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:15.986362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d1f77-cadc-4104-b9d3-da11887a867d service swift] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:15.986704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d1f77-cadc-4104-b9d3-da11887a867d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:15.997551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d1f77-cadc-4104-b9d3-da11887a867d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:15.999216 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d1f77-cadc-4104-b9d3-da11887a867d service swift] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:16.009654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1208/2434] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:28:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:28:18.203264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f8fa7-8fed-4b9c-834f-cd49f51db06b None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:18.203815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f8fa7-8fed-4b9c-834f-cd49f51db06b None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:18.203815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f8fa7-8fed-4b9c-834f-cd49f51db06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:18.234214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-0e5f8fa7-8fed-4b9c-834f-cd49f51db06b None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:18.235546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0e5f8fa7-8fed-4b9c-834f-cd49f51db06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:18.244187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1227/2435] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:28:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:28:18.274480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d1f77-cadc-4104-b9d3-da11887a867d service swift] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:18.286359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d1f77-cadc-4104-b9d3-da11887a867d service swift] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:18.294965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c429536-ecc9-44ee-a6af-0cf7444c1366 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:18.295595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c429536-ecc9-44ee-a6af-0cf7444c1366 service swift] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:18.295899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c429536-ecc9-44ee-a6af-0cf7444c1366 service swift] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:18.296146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c429536-ecc9-44ee-a6af-0cf7444c1366 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:18.306859 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c429536-ecc9-44ee-a6af-0cf7444c1366 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:18.308429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c429536-ecc9-44ee-a6af-0cf7444c1366 service swift] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:18.317926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1209/2436] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:28:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:28:28.225752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=6 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:28:28.313366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=15 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:28:35.054189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ec21-be07-4341-b69c-045be0839fb8 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:35.054711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ec21-be07-4341-b69c-045be0839fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:35.054711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ec21-be07-4341-b69c-045be0839fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:35.073959 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-c1e4ec21-be07-4341-b69c-045be0839fb8 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:35.075155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c1e4ec21-be07-4341-b69c-045be0839fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:35.082383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1228/2437] 10.222.0.61 () {58 vars in 967 bytes} [Thu Sep 22 18:28:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:35.094329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c429536-ecc9-44ee-a6af-0cf7444c1366 service swift] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:35.105505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c429536-ecc9-44ee-a6af-0cf7444c1366 service swift] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:35.110935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e46075-f26f-4185-bed6-5ac18e61c446 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:35.111664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e46075-f26f-4185-bed6-5ac18e61c446 service swift] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:35.112016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e46075-f26f-4185-bed6-5ac18e61c446 service swift] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:35.112549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e46075-f26f-4185-bed6-5ac18e61c446 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:35.121358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e46075-f26f-4185-bed6-5ac18e61c446 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:35.122926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e46075-f26f-4185-bed6-5ac18e61c446 service swift] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:35.131265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1210/2438] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:28:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:28:37.071703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f1dc1-a112-4b41-9684-6a8c6a5a47a1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:37.072166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f1dc1-a112-4b41-9684-6a8c6a5a47a1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:37.072286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f1dc1-a112-4b41-9684-6a8c6a5a47a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:37.092565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-457f1dc1-a112-4b41-9684-6a8c6a5a47a1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:37.093947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-457f1dc1-a112-4b41-9684-6a8c6a5a47a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:37.127509 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e46075-f26f-4185-bed6-5ac18e61c446 service swift] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:37.129300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-44e46075-f26f-4185-bed6-5ac18e61c446 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:37.166142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1229/2439] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:37.215610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e46075-f26f-4185-bed6-5ac18e61c446 service swift] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:37.222367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:37.223081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:37.223429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:37.223781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] PATH_INFO: `/v3/users/11957165d77e4a2295a21dae4880cf5d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:37.225039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] RBAC: Authorizing `identity:delete_user(user_id=11957165d77e4a2295a21dae4880cf5d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:37.227662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:37.298946 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11957165d77e4a2295a21dae4880cf5d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.308653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11957165d77e4a2295a21dae4880cf5d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.310110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11957165d77e4a2295a21dae4880cf5d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.337468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11957165d77e4a2295a21dae4880cf5d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.337468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11957165d77e4a2295a21dae4880cf5d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.343703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1211/2440] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:28:37 2022] DELETE /identity/v3/users/11957165d77e4a2295a21dae4880cf5d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:28:37.385097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f1dc1-a112-4b41-9684-6a8c6a5a47a1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:37.390047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-457f1dc1-a112-4b41-9684-6a8c6a5a47a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:37.486921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f1dc1-a112-4b41-9684-6a8c6a5a47a1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:37.547110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:37.548935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:37.582387 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3fa2f-d4e5-4b01-8687-054a4b86dee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:37.583751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3fa2f-d4e5-4b01-8687-054a4b86dee0 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:37.584135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3fa2f-d4e5-4b01-8687-054a4b86dee0 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:37.584579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3fa2f-d4e5-4b01-8687-054a4b86dee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:37.588271 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b5b3fa2f-d4e5-4b01-8687-054a4b86dee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:37.637782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:28:37.670967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7dcf7-0fc3-48f0-8ab5-07eebc6d759c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:37.676295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:37.677065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:37.677481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:37.677904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] PATH_INFO: `/v3/projects/7ec701b2c1a3481f9936c380eb2380ee` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:37.679883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec701b2c1a3481f9936c380eb2380ee)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:37.681611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:37.692183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:28:37.708095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3fa2f-d4e5-4b01-8687-054a4b86dee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:37.710343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3fa2f-d4e5-4b01-8687-054a4b86dee0 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:37.721408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1230/2441] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:28:37.755325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec701b2c1a3481f9936c380eb2380ee', 'request_id': 'req-d6b3237b-8a0d-46ad-b213-d31e46c05319'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.764705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec701b2c1a3481f9936c380eb2380ee', 'request_id': 'req-d6b3237b-8a0d-46ad-b213-d31e46c05319'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.776381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec701b2c1a3481f9936c380eb2380ee', 'request_id': 'req-d6b3237b-8a0d-46ad-b213-d31e46c05319'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.801630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] The token cache is being invalidate because project 7ec701b2c1a3481f9936c380eb2380ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:28:37.802033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.815266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:28:37.818556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1212/2442] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:28:37 2022] DELETE /identity/v3/projects/7ec701b2c1a3481f9936c380eb2380ee => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:28:38.776340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522526a2-9d6c-4f26-b89e-202854be4fc1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:38.776830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522526a2-9d6c-4f26-b89e-202854be4fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:38.776925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522526a2-9d6c-4f26-b89e-202854be4fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:38.795945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-522526a2-9d6c-4f26-b89e-202854be4fc1 None None] MFA Rules not processed for user `c334003dcc634b4c86ba14c542fb60aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:38.797147 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-522526a2-9d6c-4f26-b89e-202854be4fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:38.850939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1231/2443] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:28:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:40.091762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:40.093995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:40.171077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3237b-8a0d-46ad-b213-d31e46c05319 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:40.176648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ea81e-ca08-4f04-8ad3-cb11887b583e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:40.177433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ea81e-ca08-4f04-8ad3-cb11887b583e service placement] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:40.177723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ea81e-ca08-4f04-8ad3-cb11887b583e service placement] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:40.178825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ea81e-ca08-4f04-8ad3-cb11887b583e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:40.180360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-fe8ea81e-ca08-4f04-8ad3-cb11887b583e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:40.192412 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ea81e-ca08-4f04-8ad3-cb11887b583e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:40.194660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ea81e-ca08-4f04-8ad3-cb11887b583e service placement] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:40.204556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1213/2444] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:28:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:28:45.232636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed41f5-1d91-4a52-a780-69c8fb47c58a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:45.233506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed41f5-1d91-4a52-a780-69c8fb47c58a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:45.233506 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed41f5-1d91-4a52-a780-69c8fb47c58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:45.251505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c147870-d5a7-4cf6-8f76-18385d9a0813 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:45.251975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c147870-d5a7-4cf6-8f76-18385d9a0813 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:45.252084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c147870-d5a7-4cf6-8f76-18385d9a0813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:45.255413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a6ed41f5-1d91-4a52-a780-69c8fb47c58a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:45.256733 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a6ed41f5-1d91-4a52-a780-69c8fb47c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:45.272395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6c147870-d5a7-4cf6-8f76-18385d9a0813 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:45.273635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6c147870-d5a7-4cf6-8f76-18385d9a0813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:45.318977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1232/2445] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:45.334089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1214/2446] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:45.348079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed41f5-1d91-4a52-a780-69c8fb47c58a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:45.349628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a6ed41f5-1d91-4a52-a780-69c8fb47c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:45.366326 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c147870-d5a7-4cf6-8f76-18385d9a0813 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:45.367924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6c147870-d5a7-4cf6-8f76-18385d9a0813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:45.413824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:28:45.438248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed41f5-1d91-4a52-a780-69c8fb47c58a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:45.443775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421696-c57a-4f84-b414-2cb357624591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:45.444591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421696-c57a-4f84-b414-2cb357624591 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:45.444877 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421696-c57a-4f84-b414-2cb357624591 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:45.445892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421696-c57a-4f84-b414-2cb357624591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:45.449467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c147870-d5a7-4cf6-8f76-18385d9a0813 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:45.452292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:28:45.454500 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421696-c57a-4f84-b414-2cb357624591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:45.456751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421696-c57a-4f84-b414-2cb357624591 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:45.460591 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833bab7-8790-43f2-be3a-b9a826bf3e16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:45.461401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833bab7-8790-43f2-be3a-b9a826bf3e16 service swift] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:45.461518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833bab7-8790-43f2-be3a-b9a826bf3e16 service swift] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:45.461783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833bab7-8790-43f2-be3a-b9a826bf3e16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:45.467433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1233/2447] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:28:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:28:45.470479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833bab7-8790-43f2-be3a-b9a826bf3e16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:45.472062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833bab7-8790-43f2-be3a-b9a826bf3e16 service swift] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:45.481965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1215/2448] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:28:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 18:28:50.737556 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac608a8-5fc8-46bc-9503-c6787efeacc7 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:50.738777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac608a8-5fc8-46bc-9503-c6787efeacc7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:50.739270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac608a8-5fc8-46bc-9503-c6787efeacc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:50.767126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-9ac608a8-5fc8-46bc-9503-c6787efeacc7 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:50.768636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9ac608a8-5fc8-46bc-9503-c6787efeacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:50.779915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1234/2449] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:50.804860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833bab7-8790-43f2-be3a-b9a826bf3e16 service swift] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:50.810629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e833bab7-8790-43f2-be3a-b9a826bf3e16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:50.847623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833bab7-8790-43f2-be3a-b9a826bf3e16 service swift] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:50.857162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77e985-2db4-453d-ba83-0abce0d705a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:50.858440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e985-2db4-453d-ba83-0abce0d705a6 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:50.859304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e985-2db4-453d-ba83-0abce0d705a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:50.859938 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e985-2db4-453d-ba83-0abce0d705a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:50.872996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77e985-2db4-453d-ba83-0abce0d705a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:50.877819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77e985-2db4-453d-ba83-0abce0d705a6 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:50.891751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1216/2450] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:28:51.838878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac608a8-5fc8-46bc-9503-c6787efeacc7 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:51.841230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9ac608a8-5fc8-46bc-9503-c6787efeacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:51.908471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac608a8-5fc8-46bc-9503-c6787efeacc7 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:51.912079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eea38-5075-4197-882d-f2ac68c3a997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:51.912736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eea38-5075-4197-882d-f2ac68c3a997 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:51.913020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eea38-5075-4197-882d-f2ac68c3a997 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:51.913329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eea38-5075-4197-882d-f2ac68c3a997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:51.915249 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e90eea38-5075-4197-882d-f2ac68c3a997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:51.995406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eea38-5075-4197-882d-f2ac68c3a997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:51.997075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eea38-5075-4197-882d-f2ac68c3a997 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:52.007781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1235/2451] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:28:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:28:54.982223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75308d-9589-4449-8626-fcf9a23efbe1 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:54.984919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75308d-9589-4449-8626-fcf9a23efbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:54.984919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75308d-9589-4449-8626-fcf9a23efbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:55.008209 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-9b75308d-9589-4449-8626-fcf9a23efbe1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:28:55.009761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9b75308d-9589-4449-8626-fcf9a23efbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:28:55.020825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1217/2452] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:28:55.314818 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eea38-5075-4197-882d-f2ac68c3a997 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:28:55.334834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eea38-5075-4197-882d-f2ac68c3a997 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:28:55.347573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc8e6-837b-41e6-9621-dcc31b89a068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:28:55.348355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc8e6-837b-41e6-9621-dcc31b89a068 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:28:55.348798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc8e6-837b-41e6-9621-dcc31b89a068 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:28:55.349164 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc8e6-837b-41e6-9621-dcc31b89a068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:28:55.381930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc8e6-837b-41e6-9621-dcc31b89a068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:28:55.383676 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc8e6-837b-41e6-9621-dcc31b89a068 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:28:55.396166 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1236/2453] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:29:02.283582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee9f0-a48f-439b-a210-7b212108403a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:02.284022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee9f0-a48f-439b-a210-7b212108403a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:02.284150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee9f0-a48f-439b-a210-7b212108403a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:02.304217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-074ee9f0-a48f-439b-a210-7b212108403a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:29:02.305421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-074ee9f0-a48f-439b-a210-7b212108403a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:02.313004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1218/2454] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:29:02.335269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc8e6-837b-41e6-9621-dcc31b89a068 service nova] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:29:02.346163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc8e6-837b-41e6-9621-dcc31b89a068 service nova] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:29:02.352008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26fc2a-d23d-4d1d-94cd-fb2abec9254c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:29:02.352593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26fc2a-d23d-4d1d-94cd-fb2abec9254c service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:02.352871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26fc2a-d23d-4d1d-94cd-fb2abec9254c service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:02.353149 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26fc2a-d23d-4d1d-94cd-fb2abec9254c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:02.361266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26fc2a-d23d-4d1d-94cd-fb2abec9254c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:29:02.362826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26fc2a-d23d-4d1d-94cd-fb2abec9254c service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:29:02.372572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1237/2455] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:29:06.774883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcffadd-d023-4ad4-b585-41dc80bed371 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:06.775871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcffadd-d023-4ad4-b585-41dc80bed371 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:06.776346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcffadd-d023-4ad4-b585-41dc80bed371 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:06.778344 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1219/2456] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:29:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:29:06.784713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0139ec-b368-4d2a-bc56-1b861cf926db None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:06.785356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0139ec-b368-4d2a-bc56-1b861cf926db None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:06.785356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0139ec-b368-4d2a-bc56-1b861cf926db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:06.808367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-5e0139ec-b368-4d2a-bc56-1b861cf926db None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:29:06.809618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5e0139ec-b368-4d2a-bc56-1b861cf926db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:06.819237 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1238/2457] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:29:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:29:06.834886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcffadd-d023-4ad4-b585-41dc80bed371 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:29:06.836685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-dfcffadd-d023-4ad4-b585-41dc80bed371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:06.911921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcffadd-d023-4ad4-b585-41dc80bed371 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:29:06.916218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0043514-ddfb-4364-a8ce-dd5d2dd9475c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab45d09f8724d9ca5b6fb1fa050fdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:29:06.917031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0043514-ddfb-4364-a8ce-dd5d2dd9475c service glance] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:06.917439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0043514-ddfb-4364-a8ce-dd5d2dd9475c service glance] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:06.917818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0043514-ddfb-4364-a8ce-dd5d2dd9475c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:06.937486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0043514-ddfb-4364-a8ce-dd5d2dd9475c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:29:06.939188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0043514-ddfb-4364-a8ce-dd5d2dd9475c service glance] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:29:06.950720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1220/2458] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:29:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:29:07.019122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05a061-822c-4218-b31b-676f0dd42672 None None] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:07.019410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05a061-822c-4218-b31b-676f0dd42672 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:07.019685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05a061-822c-4218-b31b-676f0dd42672 None None] PATH_INFO: `/` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:07.021206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1239/2459] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:29:07.026895 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef41f1f-9703-4dfa-93e7-22b303167363 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:07.027256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef41f1f-9703-4dfa-93e7-22b303167363 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:07.027648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef41f1f-9703-4dfa-93e7-22b303167363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:07.048293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4ef41f1f-9703-4dfa-93e7-22b303167363 None None] MFA Rules not processed for user `8d0b8fc336694043a34f007b78c45c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:29:07.049524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4ef41f1f-9703-4dfa-93e7-22b303167363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:07.056092 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1221/2460] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:29:07.067894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05a061-822c-4218-b31b-676f0dd42672 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:29:07.069677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0b05a061-822c-4218-b31b-676f0dd42672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:07.085392 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05a061-822c-4218-b31b-676f0dd42672 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:29:07.088948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f0960-8621-4060-988c-dc7a4c24cec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:29:07.089577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f0960-8621-4060-988c-dc7a4c24cec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:07.089859 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f0960-8621-4060-988c-dc7a4c24cec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:07.090130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f0960-8621-4060-988c-dc7a4c24cec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:07.097112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f0960-8621-4060-988c-dc7a4c24cec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:29:07.098578 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f0960-8621-4060-988c-dc7a4c24cec0 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:29:07.106582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1240/2461] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:29:07.206996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4392f4c-434f-4694-96f6-122bd277dec8 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:07.207281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4392f4c-434f-4694-96f6-122bd277dec8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:07.207554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4392f4c-434f-4694-96f6-122bd277dec8 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:07.208896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1222/2462] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:29:07.214243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b2630-8ba4-4aed-b4fe-e363dedacb01 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:07.214616 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b2630-8ba4-4aed-b4fe-e363dedacb01 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:07.215113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b2630-8ba4-4aed-b4fe-e363dedacb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:07.236054 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-194b2630-8ba4-4aed-b4fe-e363dedacb01 None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:29:07.237367 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-194b2630-8ba4-4aed-b4fe-e363dedacb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:07.247190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1241/2463] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:29:07.260140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4392f4c-434f-4694-96f6-122bd277dec8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:29:07.289365 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4392f4c-434f-4694-96f6-122bd277dec8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:29:07.297508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9a890-9081-4591-b8b0-1ef9bf91db99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:29:07.298422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9a890-9081-4591-b8b0-1ef9bf91db99 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:07.298881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9a890-9081-4591-b8b0-1ef9bf91db99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:07.299320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9a890-9081-4591-b8b0-1ef9bf91db99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:07.310657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9a890-9081-4591-b8b0-1ef9bf91db99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:29:07.312316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9a890-9081-4591-b8b0-1ef9bf91db99 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:29:07.327334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1223/2464] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:29:08.564286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204021-484c-4a32-99a7-99e2031bc156 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:08.564995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204021-484c-4a32-99a7-99e2031bc156 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:08.564995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204021-484c-4a32-99a7-99e2031bc156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:08.585537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-21204021-484c-4a32-99a7-99e2031bc156 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:29:08.586735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-21204021-484c-4a32-99a7-99e2031bc156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:08.594788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1242/2465] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:29:08.629744 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9a890-9081-4591-b8b0-1ef9bf91db99 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:29:08.642363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9a890-9081-4591-b8b0-1ef9bf91db99 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:29:08.648970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea3c32-486b-44bf-80b5-17ec4aace135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:29:08.649926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea3c32-486b-44bf-80b5-17ec4aace135 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:08.650229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea3c32-486b-44bf-80b5-17ec4aace135 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:08.650504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea3c32-486b-44bf-80b5-17ec4aace135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:08.659783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea3c32-486b-44bf-80b5-17ec4aace135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:29:08.661202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea3c32-486b-44bf-80b5-17ec4aace135 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:29:08.672056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1224/2466] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:29:12.170161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fb8c7-26a4-499a-8a64-da17afe93308 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:12.170631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fb8c7-26a4-499a-8a64-da17afe93308 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:12.170739 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fb8c7-26a4-499a-8a64-da17afe93308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:12.189631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-664fb8c7-26a4-499a-8a64-da17afe93308 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:29:12.190760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-664fb8c7-26a4-499a-8a64-da17afe93308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:12.198079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1243/2467] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:29:12.209544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea3c32-486b-44bf-80b5-17ec4aace135 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:29:12.221077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea3c32-486b-44bf-80b5-17ec4aace135 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:29:12.226768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782b9c5-0540-4bd3-a1bf-206d690656e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:29:12.227370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782b9c5-0540-4bd3-a1bf-206d690656e7 service swift] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:12.227657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782b9c5-0540-4bd3-a1bf-206d690656e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:12.227934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782b9c5-0540-4bd3-a1bf-206d690656e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:12.236119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782b9c5-0540-4bd3-a1bf-206d690656e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:29:12.237722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782b9c5-0540-4bd3-a1bf-206d690656e7 service swift] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:29:12.246607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1225/2468] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:29:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:29:22.184159 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=85 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:29:22.242554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=77 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:29:43.163940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d5614-156a-49d0-8ed6-b99630e9e55d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:43.165288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d5614-156a-49d0-8ed6-b99630e9e55d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:43.165288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d5614-156a-49d0-8ed6-b99630e9e55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:43.186405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-c17d5614-156a-49d0-8ed6-b99630e9e55d None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:29:43.187715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c17d5614-156a-49d0-8ed6-b99630e9e55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:43.195145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1244/2469] 10.222.0.61 () {58 vars in 967 bytes} [Thu Sep 22 18:29:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:29:43.207889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782b9c5-0540-4bd3-a1bf-206d690656e7 service swift] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:29:43.219311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782b9c5-0540-4bd3-a1bf-206d690656e7 service swift] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:29:43.224254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82ef63-4c9c-417c-8ffe-1b67a800f989 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:29:43.224845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82ef63-4c9c-417c-8ffe-1b67a800f989 service swift] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:43.225123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82ef63-4c9c-417c-8ffe-1b67a800f989 service swift] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:43.225425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82ef63-4c9c-417c-8ffe-1b67a800f989 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:43.233740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82ef63-4c9c-417c-8ffe-1b67a800f989 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:29:43.235582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82ef63-4c9c-417c-8ffe-1b67a800f989 service swift] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:29:43.243443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1226/2470] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:29:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:29:47.645091 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42ffb7-6433-4104-b2f2-c51d261d5dc0 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:29:47.645604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42ffb7-6433-4104-b2f2-c51d261d5dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:29:47.645719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42ffb7-6433-4104-b2f2-c51d261d5dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:29:47.665909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4c42ffb7-6433-4104-b2f2-c51d261d5dc0 None None] MFA Rules not processed for user `cf48e411b3034abb8009aa5b23821b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:29:47.667118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4c42ffb7-6433-4104-b2f2-c51d261d5dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:29:47.722766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1245/2471] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:29:53.240223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=6 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:29:57.715996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=28 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:30:05.094311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff923b6-79b2-450d-87a4-62540575c18a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:05.094941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff923b6-79b2-450d-87a4-62540575c18a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:05.094941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff923b6-79b2-450d-87a4-62540575c18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:05.114933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-0ff923b6-79b2-450d-87a4-62540575c18a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:30:05.116152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-0ff923b6-79b2-450d-87a4-62540575c18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:05.124698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1227/2472] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:30:05.158318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42ffb7-6433-4104-b2f2-c51d261d5dc0 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:05.171760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42ffb7-6433-4104-b2f2-c51d261d5dc0 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:05.177095 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939fd3d-9066-49fe-862f-69abc68d2329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:05.177750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939fd3d-9066-49fe-862f-69abc68d2329 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:05.178028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939fd3d-9066-49fe-862f-69abc68d2329 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:05.178301 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939fd3d-9066-49fe-862f-69abc68d2329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:05.186954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939fd3d-9066-49fe-862f-69abc68d2329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:05.188519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939fd3d-9066-49fe-862f-69abc68d2329 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:05.197992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1246/2473] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:08.343513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e32c5-906a-41f1-859f-c016ebd1d200 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:08.344074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e32c5-906a-41f1-859f-c016ebd1d200 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:08.344074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e32c5-906a-41f1-859f-c016ebd1d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:08.363651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-009e32c5-906a-41f1-859f-c016ebd1d200 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:30:08.364852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-009e32c5-906a-41f1-859f-c016ebd1d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:08.373290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1228/2474] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:30:08.395286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939fd3d-9066-49fe-862f-69abc68d2329 service nova] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:08.407882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939fd3d-9066-49fe-862f-69abc68d2329 service nova] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:08.413572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100194a-2e87-41d9-8aa3-f67dba20cd18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:08.414175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100194a-2e87-41d9-8aa3-f67dba20cd18 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:08.414459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100194a-2e87-41d9-8aa3-f67dba20cd18 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:08.414763 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100194a-2e87-41d9-8aa3-f67dba20cd18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:08.423744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100194a-2e87-41d9-8aa3-f67dba20cd18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:08.425357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100194a-2e87-41d9-8aa3-f67dba20cd18 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:08.434769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1247/2475] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:12.463713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7575ad-16a4-40a6-92e8-2aa010f9c2c0 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:12.464213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7575ad-16a4-40a6-92e8-2aa010f9c2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:12.464324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7575ad-16a4-40a6-92e8-2aa010f9c2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:12.483333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-7c7575ad-16a4-40a6-92e8-2aa010f9c2c0 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:30:12.484533 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7c7575ad-16a4-40a6-92e8-2aa010f9c2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:12.492816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1229/2476] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:30:12.513726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100194a-2e87-41d9-8aa3-f67dba20cd18 service nova] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:12.525687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100194a-2e87-41d9-8aa3-f67dba20cd18 service nova] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:12.531554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109d30e-4994-41dc-8de9-faf880022688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:12.532190 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109d30e-4994-41dc-8de9-faf880022688 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:12.532486 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109d30e-4994-41dc-8de9-faf880022688 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:12.532750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109d30e-4994-41dc-8de9-faf880022688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:12.540911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109d30e-4994-41dc-8de9-faf880022688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:12.542520 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109d30e-4994-41dc-8de9-faf880022688 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:12.552134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1248/2477] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:17.525941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed014-d39f-4998-be5b-a83fb52ea96e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:17.526426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed014-d39f-4998-be5b-a83fb52ea96e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:17.526546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed014-d39f-4998-be5b-a83fb52ea96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:17.545072 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-651ed014-d39f-4998-be5b-a83fb52ea96e None None] MFA Rules not processed for user `36d7b059ff874d0db44ceecb2f95830c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:30:17.546292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-651ed014-d39f-4998-be5b-a83fb52ea96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:17.604600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1230/2478] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:30:18.724211 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e930ea-37ba-4be6-a840-7759a02629da None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:18.724670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e930ea-37ba-4be6-a840-7759a02629da None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:18.724791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e930ea-37ba-4be6-a840-7759a02629da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:18.745255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-79e930ea-37ba-4be6-a840-7759a02629da None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:30:18.746477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-79e930ea-37ba-4be6-a840-7759a02629da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:18.754319 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1249/2479] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:30:18.777812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ed014-d39f-4998-be5b-a83fb52ea96e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:18.790419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ed014-d39f-4998-be5b-a83fb52ea96e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:18.796552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0809ca-846a-4f3a-a9cf-a34dc4e8de61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:18.797159 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0809ca-846a-4f3a-a9cf-a34dc4e8de61 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:18.797469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0809ca-846a-4f3a-a9cf-a34dc4e8de61 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:18.797761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0809ca-846a-4f3a-a9cf-a34dc4e8de61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:18.805927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0809ca-846a-4f3a-a9cf-a34dc4e8de61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:18.807504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0809ca-846a-4f3a-a9cf-a34dc4e8de61 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:18.816784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1231/2480] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:26.066027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2bfd-6636-4dd8-af5b-4b8ad5203a9d None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:26.066590 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2bfd-6636-4dd8-af5b-4b8ad5203a9d None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:26.066698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2bfd-6636-4dd8-af5b-4b8ad5203a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:26.086133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a73f2bfd-6636-4dd8-af5b-4b8ad5203a9d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:30:26.087277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a73f2bfd-6636-4dd8-af5b-4b8ad5203a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:26.095250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1250/2481] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 18:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:30:26.117353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0809ca-846a-4f3a-a9cf-a34dc4e8de61 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:26.128331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0809ca-846a-4f3a-a9cf-a34dc4e8de61 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:26.133896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfcf19-20ea-4865-9cbd-0dc033c1f0b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:26.134513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfcf19-20ea-4865-9cbd-0dc033c1f0b1 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:26.135465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfcf19-20ea-4865-9cbd-0dc033c1f0b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:26.137189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfcf19-20ea-4865-9cbd-0dc033c1f0b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:26.146819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfcf19-20ea-4865-9cbd-0dc033c1f0b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:26.148399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfcf19-20ea-4865-9cbd-0dc033c1f0b1 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:26.158636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1232/2482] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:29.537888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f2bfd-6636-4dd8-af5b-4b8ad5203a9d None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:29.542759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=25 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:30:29.548705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f2bfd-6636-4dd8-af5b-4b8ad5203a9d None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:29.552290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fa750-dc93-46d7-8742-b401fd18756c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:29.552897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fa750-dc93-46d7-8742-b401fd18756c service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:29.553183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fa750-dc93-46d7-8742-b401fd18756c service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:29.553504 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fa750-dc93-46d7-8742-b401fd18756c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:29.555255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-491fa750-dc93-46d7-8742-b401fd18756c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:29.569428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fa750-dc93-46d7-8742-b401fd18756c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:29.570858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fa750-dc93-46d7-8742-b401fd18756c service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:29.582630 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1251/2483] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:30.218445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfcf19-20ea-4865-9cbd-0dc033c1f0b1 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:30.220254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-41cfcf19-20ea-4865-9cbd-0dc033c1f0b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:30.281150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfcf19-20ea-4865-9cbd-0dc033c1f0b1 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:30.284805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065c9c0-6c2a-496d-bf9f-aefa160d712f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:30.285449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c9c0-6c2a-496d-bf9f-aefa160d712f service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:30.285734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c9c0-6c2a-496d-bf9f-aefa160d712f service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:30.286013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c9c0-6c2a-496d-bf9f-aefa160d712f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:30.287768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1065c9c0-6c2a-496d-bf9f-aefa160d712f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:30.301766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065c9c0-6c2a-496d-bf9f-aefa160d712f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:30.303202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065c9c0-6c2a-496d-bf9f-aefa160d712f service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:30.315108 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1233/2484] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:38.539991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fa750-dc93-46d7-8742-b401fd18756c service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:38.552017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fa750-dc93-46d7-8742-b401fd18756c service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:38.557694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976374-cb7d-4fad-b4e7-0938ca306035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:38.558303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976374-cb7d-4fad-b4e7-0938ca306035 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:38.558650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976374-cb7d-4fad-b4e7-0938ca306035 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:38.558928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976374-cb7d-4fad-b4e7-0938ca306035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:38.560652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e2976374-cb7d-4fad-b4e7-0938ca306035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:38.571696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2976374-cb7d-4fad-b4e7-0938ca306035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:38.573306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2976374-cb7d-4fad-b4e7-0938ca306035 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:38.582551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1252/2485] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:40.309783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=72 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:30:48.578344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=11 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:30:51.444027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065c9c0-6c2a-496d-bf9f-aefa160d712f service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:51.456402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065c9c0-6c2a-496d-bf9f-aefa160d712f service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:51.462422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548ca38-2979-4b33-bdf4-e83d3fbb4671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:51.463152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548ca38-2979-4b33-bdf4-e83d3fbb4671 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:51.463462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548ca38-2979-4b33-bdf4-e83d3fbb4671 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:51.463797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548ca38-2979-4b33-bdf4-e83d3fbb4671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:51.466462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f548ca38-2979-4b33-bdf4-e83d3fbb4671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:51.528069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548ca38-2979-4b33-bdf4-e83d3fbb4671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:51.529702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548ca38-2979-4b33-bdf4-e83d3fbb4671 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:51.539086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1234/2486] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:52.091607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b2b5f-4872-464e-81bf-9646cd304622 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:52.092116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b2b5f-4872-464e-81bf-9646cd304622 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:52.092232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b2b5f-4872-464e-81bf-9646cd304622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:52.111080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-216b2b5f-4872-464e-81bf-9646cd304622 None None] MFA Rules not processed for user `c334003dcc634b4c86ba14c542fb60aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:30:52.112526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-216b2b5f-4872-464e-81bf-9646cd304622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:52.119280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1253/2487] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:30:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:30:52.418586 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548ca38-2979-4b33-bdf4-e83d3fbb4671 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:52.428175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548ca38-2979-4b33-bdf4-e83d3fbb4671 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:52.431901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05793f6-3920-4341-88e2-351210609926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:52.432511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05793f6-3920-4341-88e2-351210609926 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:52.432789 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05793f6-3920-4341-88e2-351210609926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:52.433063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05793f6-3920-4341-88e2-351210609926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:52.435619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f05793f6-3920-4341-88e2-351210609926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:52.445719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05793f6-3920-4341-88e2-351210609926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:52.447362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05793f6-3920-4341-88e2-351210609926 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:52.455681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1235/2488] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:30:52.775431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b2b5f-4872-464e-81bf-9646cd304622 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:30:52.777726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-216b2b5f-4872-464e-81bf-9646cd304622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:52.795043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b2b5f-4872-464e-81bf-9646cd304622 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:30:52.800665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f92579-33b1-443c-81b4-f447cb8a642b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:30:52.801452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f92579-33b1-443c-81b4-f447cb8a642b service placement] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:30:52.801890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f92579-33b1-443c-81b4-f447cb8a642b service placement] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:30:52.802251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f92579-33b1-443c-81b4-f447cb8a642b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:30:52.804302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e5f92579-33b1-443c-81b4-f447cb8a642b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:30:52.819389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f92579-33b1-443c-81b4-f447cb8a642b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:30:52.821011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f92579-33b1-443c-81b4-f447cb8a642b service placement] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:30:52.834741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1254/2489] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:30:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:00.272688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108008f-54cf-4601-82fc-cbb345bd9df0 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:00.273223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108008f-54cf-4601-82fc-cbb345bd9df0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:00.273223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108008f-54cf-4601-82fc-cbb345bd9df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:00.293392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-9108008f-54cf-4601-82fc-cbb345bd9df0 None None] MFA Rules not processed for user `626b85e5875b4d47b410f4f43aca0497`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:31:00.294606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9108008f-54cf-4601-82fc-cbb345bd9df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:00.301405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1236/2490] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:31:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:31:00.510455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f92579-33b1-443c-81b4-f447cb8a642b service placement] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:00.520355 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f92579-33b1-443c-81b4-f447cb8a642b service placement] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:00.523875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:00.524476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:00.524752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:00.525023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:00.526768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:00.537161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:00.538593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:00.546640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1255/2491] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:00.656481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108008f-54cf-4601-82fc-cbb345bd9df0 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:00.669693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108008f-54cf-4601-82fc-cbb345bd9df0 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:00.673636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42af33-9c37-4f93-af8c-1fcacab8bd75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:00.674267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42af33-9c37-4f93-af8c-1fcacab8bd75 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:00.674550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42af33-9c37-4f93-af8c-1fcacab8bd75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:00.674822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42af33-9c37-4f93-af8c-1fcacab8bd75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:00.677801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-af42af33-9c37-4f93-af8c-1fcacab8bd75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:00.688462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42af33-9c37-4f93-af8c-1fcacab8bd75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:00.690256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42af33-9c37-4f93-af8c-1fcacab8bd75 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:00.700397 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1237/2492] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:02.323879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:02.325472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:02.340695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2150e5-e3fe-437f-9a8a-56af58490fbf service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:02.345776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:02.346040 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:02.346312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:02.346765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] PATH_INFO: `/v3/users/cf48e411b3034abb8009aa5b23821b88` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:02.348052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf48e411b3034abb8009aa5b23821b88)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:02.350185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:02.413540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf48e411b3034abb8009aa5b23821b88'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.421986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf48e411b3034abb8009aa5b23821b88'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.422652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf48e411b3034abb8009aa5b23821b88'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.436061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf48e411b3034abb8009aa5b23821b88'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.443774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-7e879391-5346-4b2c-a486-84e9ee98db9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf48e411b3034abb8009aa5b23821b88'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.450358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1256/2493] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:31:02 2022] DELETE /identity/v3/users/cf48e411b3034abb8009aa5b23821b88 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:31:02.632364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42af33-9c37-4f93-af8c-1fcacab8bd75 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:02.664212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42af33-9c37-4f93-af8c-1fcacab8bd75 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:02.723462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:02.724420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:02.724706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:02.724983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] PATH_INFO: `/v3/projects/b1d19dab1697488c9de84cf64905033b` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:02.726164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d19dab1697488c9de84cf64905033b)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:02.728888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:02.780421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d19dab1697488c9de84cf64905033b', 'request_id': 'req-e7ea1d8c-0d26-448f-91e8-58156d590ad1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.787993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d19dab1697488c9de84cf64905033b', 'request_id': 'req-e7ea1d8c-0d26-448f-91e8-58156d590ad1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.793892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d19dab1697488c9de84cf64905033b', 'request_id': 'req-e7ea1d8c-0d26-448f-91e8-58156d590ad1'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.795808 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:02.808852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] The token cache is being invalidate because project b1d19dab1697488c9de84cf64905033b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:31:02.809145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.809837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-e7ea1d8c-0d26-448f-91e8-58156d590ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:02.813312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1238/2494] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:31:02 2022] DELETE /identity/v3/projects/b1d19dab1697488c9de84cf64905033b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:31:02.816602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe201c-4014-4e87-acc2-9b8faab7b6f2 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:02.816886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe201c-4014-4e87-acc2-9b8faab7b6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:02.817161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe201c-4014-4e87-acc2-9b8faab7b6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:02.837022 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-0bbe201c-4014-4e87-acc2-9b8faab7b6f2 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:31:02.838258 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0bbe201c-4014-4e87-acc2-9b8faab7b6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:02.898077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1257/2495] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:31:02.906729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52712b4-29f3-494a-9814-5bbc1af9806c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:02.907016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52712b4-29f3-494a-9814-5bbc1af9806c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:02.907297 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52712b4-29f3-494a-9814-5bbc1af9806c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:02.926713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f52712b4-29f3-494a-9814-5bbc1af9806c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:31:02.927918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f52712b4-29f3-494a-9814-5bbc1af9806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:02.936999 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1239/2496] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:31:02.941346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe201c-4014-4e87-acc2-9b8faab7b6f2 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:02.951610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe201c-4014-4e87-acc2-9b8faab7b6f2 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:02.956138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ec3a9-940f-4ef4-ab86-97fb27ef64e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:02.956739 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ec3a9-940f-4ef4-ab86-97fb27ef64e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:02.957021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ec3a9-940f-4ef4-ab86-97fb27ef64e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:02.957339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ec3a9-940f-4ef4-ab86-97fb27ef64e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:02.957988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ec3a9-940f-4ef4-ab86-97fb27ef64e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:31:02.958303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ec3a9-940f-4ef4-ab86-97fb27ef64e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:02.959899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ec3a9-940f-4ef4-ab86-97fb27ef64e9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:02.972421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1258/2497] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:31:02.978353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52712b4-29f3-494a-9814-5bbc1af9806c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:02.988161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52712b4-29f3-494a-9814-5bbc1af9806c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:02.993079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae7bb-da60-4b15-a739-b4a46084dd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:02.993722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae7bb-da60-4b15-a739-b4a46084dd4a admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:02.994005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae7bb-da60-4b15-a739-b4a46084dd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:02.994280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae7bb-da60-4b15-a739-b4a46084dd4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:02.994909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfae7bb-da60-4b15-a739-b4a46084dd4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:02.997346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfae7bb-da60-4b15-a739-b4a46084dd4a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:03.025937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1240/2498] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:31:02 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:31:03.030139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ec3a9-940f-4ef4-ab86-97fb27ef64e9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:03.040519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ec3a9-940f-4ef4-ab86-97fb27ef64e9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:03.065344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:03.100136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eb042-6351-4784-82ca-e7fd9f575595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:03.100732 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eb042-6351-4784-82ca-e7fd9f575595 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:03.101012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eb042-6351-4784-82ca-e7fd9f575595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:03.101306 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eb042-6351-4784-82ca-e7fd9f575595 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:03.102079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03eb042-6351-4784-82ca-e7fd9f575595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:03.104019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03eb042-6351-4784-82ca-e7fd9f575595 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:03.126285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1259/2499] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:31:03 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:31:03.130715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae7bb-da60-4b15-a739-b4a46084dd4a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:03.141904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae7bb-da60-4b15-a739-b4a46084dd4a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:03.157127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4266774-0db9-4fb5-9bcc-7c565bee9c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:03.157802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4266774-0db9-4fb5-9bcc-7c565bee9c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:03.158103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4266774-0db9-4fb5-9bcc-7c565bee9c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:03.158379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4266774-0db9-4fb5-9bcc-7c565bee9c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:03.159025 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4266774-0db9-4fb5-9bcc-7c565bee9c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:03.160609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4266774-0db9-4fb5-9bcc-7c565bee9c56 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:03.176423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eb042-6351-4784-82ca-e7fd9f575595 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:03.177432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1241/2500] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:31:03.196729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eb042-6351-4784-82ca-e7fd9f575595 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:03.202443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8f4ca-9cba-4583-a2ac-ea1631c699e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:03.203075 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f4ca-9cba-4583-a2ac-ea1631c699e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:03.203456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f4ca-9cba-4583-a2ac-ea1631c699e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:03.203620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f4ca-9cba-4583-a2ac-ea1631c699e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:03.204284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8f4ca-9cba-4583-a2ac-ea1631c699e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:03.206544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8f4ca-9cba-4583-a2ac-ea1631c699e8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:03.227147 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1260/2501] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:31:03.229483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4266774-0db9-4fb5-9bcc-7c565bee9c56 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:03.243283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4266774-0db9-4fb5-9bcc-7c565bee9c56 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:03.252630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32a548-cad1-459a-8924-caabace7c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:03.253446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32a548-cad1-459a-8924-caabace7c1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:03.253737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32a548-cad1-459a-8924-caabace7c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:03.254018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32a548-cad1-459a-8924-caabace7c1c6 admin admin] PATH_INFO: `/v3/projects/a2c397452fff40b4b1c89baf4fa095b4/users/05b1d04112a04086a3766453e40bc922/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:03.272219 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32a548-cad1-459a-8924-caabace7c1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c397452fff40b4b1c89baf4fa095b4, user_id=05b1d04112a04086a3766453e40bc922, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:03.275275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32a548-cad1-459a-8924-caabace7c1c6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:03.301483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1242/2502] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:31:03 2022] PUT /identity/v3/projects/a2c397452fff40b4b1c89baf4fa095b4/users/05b1d04112a04086a3766453e40bc922/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:31:03.306828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e70731-d23c-468d-87ab-f76d33c13a9f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:03.307217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e70731-d23c-468d-87ab-f76d33c13a9f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:03.307729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e70731-d23c-468d-87ab-f76d33c13a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:03.334880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-97e70731-d23c-468d-87ab-f76d33c13a9f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:31:03.337067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-97e70731-d23c-468d-87ab-f76d33c13a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:03.452371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1261/2503] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:31:03.463961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32a548-cad1-459a-8924-caabace7c1c6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:03.466224 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5d32a548-cad1-459a-8924-caabace7c1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:03.543127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32a548-cad1-459a-8924-caabace7c1c6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:03.547556 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1a09-db22-4c85-8f94-f49a6d07a075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:03.548327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1a09-db22-4c85-8f94-f49a6d07a075 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:03.548681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1a09-db22-4c85-8f94-f49a6d07a075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:03.549071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1a09-db22-4c85-8f94-f49a6d07a075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:03.559446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1a09-db22-4c85-8f94-f49a6d07a075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:03.561510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1a09-db22-4c85-8f94-f49a6d07a075 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:03.571708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1243/2504] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:08.345661 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a504efd-6d96-48d3-9304-4a45b2158a41 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:08.346213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a504efd-6d96-48d3-9304-4a45b2158a41 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:08.346213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a504efd-6d96-48d3-9304-4a45b2158a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:08.379330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4a504efd-6d96-48d3-9304-4a45b2158a41 None None] MFA Rules not processed for user `05b1d04112a04086a3766453e40bc922`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:31:08.380677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4a504efd-6d96-48d3-9304-4a45b2158a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:08.457407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1262/2505] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:31:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:31:08.462477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1a09-db22-4c85-8f94-f49a6d07a075 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:08.473819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1a09-db22-4c85-8f94-f49a6d07a075 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:08.479962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f8709-b201-490a-ad38-351dd892a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:08.481299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f8709-b201-490a-ad38-351dd892a371 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:08.481853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f8709-b201-490a-ad38-351dd892a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:08.482306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f8709-b201-490a-ad38-351dd892a371 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:08.483204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f8709-b201-490a-ad38-351dd892a371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:08.485220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f8709-b201-490a-ad38-351dd892a371 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:08.522065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1244/2506] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:31:08 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:31:08.523671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a504efd-6d96-48d3-9304-4a45b2158a41 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:08.536057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a504efd-6d96-48d3-9304-4a45b2158a41 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:08.573321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:08.604499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025381-e420-4ffc-b651-2a838dd7688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:08.605979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025381-e420-4ffc-b651-2a838dd7688e admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:08.605979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025381-e420-4ffc-b651-2a838dd7688e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:08.606182 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025381-e420-4ffc-b651-2a838dd7688e admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:08.606851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4025381-e420-4ffc-b651-2a838dd7688e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:08.609001 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4025381-e420-4ffc-b651-2a838dd7688e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:08.634614 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1263/2507] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:31:08 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:31:08.638928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f8709-b201-490a-ad38-351dd892a371 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:08.651066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f8709-b201-490a-ad38-351dd892a371 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:08.657033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad782a0-6982-4496-95d4-01899aef7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:08.657751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad782a0-6982-4496-95d4-01899aef7b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:08.658039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad782a0-6982-4496-95d4-01899aef7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:08.658319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad782a0-6982-4496-95d4-01899aef7b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:08.659345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad782a0-6982-4496-95d4-01899aef7b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:08.660585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad782a0-6982-4496-95d4-01899aef7b38 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:08.673990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1245/2508] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:31:08.677615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025381-e420-4ffc-b651-2a838dd7688e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:08.688339 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025381-e420-4ffc-b651-2a838dd7688e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:08.694090 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927bfd-a15c-4a9b-b221-f8284357ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:08.694864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927bfd-a15c-4a9b-b221-f8284357ec75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:08.695557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927bfd-a15c-4a9b-b221-f8284357ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:08.695849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927bfd-a15c-4a9b-b221-f8284357ec75 admin admin] PATH_INFO: `/v3/projects/956959a269654e6d949bd10891337640/users/fad72ce83d704597afca759711f12f77/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:08.715535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927bfd-a15c-4a9b-b221-f8284357ec75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956959a269654e6d949bd10891337640, user_id=fad72ce83d704597afca759711f12f77, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:08.718255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927bfd-a15c-4a9b-b221-f8284357ec75 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:08.734160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1264/2509] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:31:08 2022] PUT /identity/v3/projects/956959a269654e6d949bd10891337640/users/fad72ce83d704597afca759711f12f77/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:31:08.738232 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad782a0-6982-4496-95d4-01899aef7b38 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:08.753772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad782a0-6982-4496-95d4-01899aef7b38 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:08.832543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19912a5b-aa1c-48a6-b279-443da74e4ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:08.833205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19912a5b-aa1c-48a6-b279-443da74e4ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:08.833543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19912a5b-aa1c-48a6-b279-443da74e4ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:08.833825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19912a5b-aa1c-48a6-b279-443da74e4ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:08.834539 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19912a5b-aa1c-48a6-b279-443da74e4ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:08.836149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19912a5b-aa1c-48a6-b279-443da74e4ef0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:08.838576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:08.848284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1246/2510] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:31:08.852337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927bfd-a15c-4a9b-b221-f8284357ec75 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:08.864518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927bfd-a15c-4a9b-b221-f8284357ec75 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:08.869589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360be08e-84a5-4e57-802d-858182c337e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:08.870329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360be08e-84a5-4e57-802d-858182c337e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:08.870615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360be08e-84a5-4e57-802d-858182c337e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:08.871083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360be08e-84a5-4e57-802d-858182c337e4 admin admin] PATH_INFO: `/v3/projects/956959a269654e6d949bd10891337640/users/fad72ce83d704597afca759711f12f77/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:08.873299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360be08e-84a5-4e57-802d-858182c337e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956959a269654e6d949bd10891337640, user_id=fad72ce83d704597afca759711f12f77, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:08.875900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360be08e-84a5-4e57-802d-858182c337e4 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:08.897303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1265/2511] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:31:08 2022] PUT /identity/v3/projects/956959a269654e6d949bd10891337640/users/fad72ce83d704597afca759711f12f77/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:31:14.017020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6294fc6-21aa-4cf6-8795-d228906a2bc8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:14.017632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6294fc6-21aa-4cf6-8795-d228906a2bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:14.017632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6294fc6-21aa-4cf6-8795-d228906a2bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:14.050902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d6294fc6-21aa-4cf6-8795-d228906a2bc8 None None] MFA Rules not processed for user `fad72ce83d704597afca759711f12f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:31:14.052126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d6294fc6-21aa-4cf6-8795-d228906a2bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:14.156341 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1247/2512] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:31:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:31:14.170282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360be08e-84a5-4e57-802d-858182c337e4 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:14.172097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-360be08e-84a5-4e57-802d-858182c337e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:14.323908 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360be08e-84a5-4e57-802d-858182c337e4 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:14.330363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531d750-2591-42e4-b2be-8fbbc666f2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:14.331089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531d750-2591-42e4-b2be-8fbbc666f2b9 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:14.331439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531d750-2591-42e4-b2be-8fbbc666f2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:14.331778 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531d750-2591-42e4-b2be-8fbbc666f2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:14.397935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531d750-2591-42e4-b2be-8fbbc666f2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:14.400173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531d750-2591-42e4-b2be-8fbbc666f2b9 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:14.417459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1266/2513] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:15.431748 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b4c9-52c0-4d81-b6b5-43cba91dda07 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:15.432610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b4c9-52c0-4d81-b6b5-43cba91dda07 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:15.433060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b4c9-52c0-4d81-b6b5-43cba91dda07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:15.457331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3713b4c9-52c0-4d81-b6b5-43cba91dda07 None None] MFA Rules not processed for user `05b1d04112a04086a3766453e40bc922`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:31:15.458557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3713b4c9-52c0-4d81-b6b5-43cba91dda07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:15.466379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1248/2514] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:31:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:31:16.912539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531d750-2591-42e4-b2be-8fbbc666f2b9 service nova] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:16.920255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f531d750-2591-42e4-b2be-8fbbc666f2b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:16.937329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531d750-2591-42e4-b2be-8fbbc666f2b9 service nova] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:16.945085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9b733-74ce-41e6-9822-bf48d0302e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:16.945743 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b733-74ce-41e6-9822-bf48d0302e48 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:16.946030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b733-74ce-41e6-9822-bf48d0302e48 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:16.946310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b733-74ce-41e6-9822-bf48d0302e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:16.948103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-def9b733-74ce-41e6-9822-bf48d0302e48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:16.972046 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9b733-74ce-41e6-9822-bf48d0302e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:16.973857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9b733-74ce-41e6-9822-bf48d0302e48 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:16.988427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1267/2515] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:31:25.448883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=38 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:26.981654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=90,keystone:INSERT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:31.541069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b4c9-52c0-4d81-b6b5-43cba91dda07 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:31.542526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3713b4c9-52c0-4d81-b6b5-43cba91dda07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:31.598006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b4c9-52c0-4d81-b6b5-43cba91dda07 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:31.601573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799120c-5319-4e41-ab1e-e02eb634c6a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:31.602183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799120c-5319-4e41-ab1e-e02eb634c6a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:31.602470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799120c-5319-4e41-ab1e-e02eb634c6a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:31.602743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799120c-5319-4e41-ab1e-e02eb634c6a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:31.604447 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8799120c-5319-4e41-ab1e-e02eb634c6a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:31.663182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799120c-5319-4e41-ab1e-e02eb634c6a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:31.664625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799120c-5319-4e41-ab1e-e02eb634c6a8 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:31.675037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1249/2516] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:39.882490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9b733-74ce-41e6-9822-bf48d0302e48 service nova] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:39.895508 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9b733-74ce-41e6-9822-bf48d0302e48 service nova] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:39.913903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:39.915314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:39.915910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:39.916484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:39.922017 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:39.942840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:39.946290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:39.973663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1268/2517] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:41.670792 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=48 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:47.814528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799120c-5319-4e41-ab1e-e02eb634c6a8 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:47.828871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799120c-5319-4e41-ab1e-e02eb634c6a8 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:47.835598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd4639-07f2-4b30-ab26-61b558dd519e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:47.836225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd4639-07f2-4b30-ab26-61b558dd519e service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:47.836513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd4639-07f2-4b30-ab26-61b558dd519e service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:47.836794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd4639-07f2-4b30-ab26-61b558dd519e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:47.838578 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-24cd4639-07f2-4b30-ab26-61b558dd519e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:47.854021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd4639-07f2-4b30-ab26-61b558dd519e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:47.855658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd4639-07f2-4b30-ab26-61b558dd519e service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:47.866959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1250/2518] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:49.955344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=6 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:53.586973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:53.588452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:53.644857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88428c-7431-4b64-928c-7c7512bb86b5 service nova] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:53.648454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e9f28-a629-4910-ae3e-d0d545928573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:53.649060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9f28-a629-4910-ae3e-d0d545928573 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:53.649466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9f28-a629-4910-ae3e-d0d545928573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:53.649747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9f28-a629-4910-ae3e-d0d545928573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:53.659191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e9f28-a629-4910-ae3e-d0d545928573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:53.660658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e9f28-a629-4910-ae3e-d0d545928573 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:53.670249 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1269/2519] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:54.076729 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd4639-07f2-4b30-ab26-61b558dd519e service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:54.086003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd4639-07f2-4b30-ab26-61b558dd519e service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:54.089576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:54.090158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:54.090436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:54.090709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:54.092414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:54.163047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:54.164515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:54.174443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1251/2520] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:31:58.857907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e9f28-a629-4910-ae3e-d0d545928573 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:58.860014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d12e9f28-a629-4910-ae3e-d0d545928573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:58.939211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:58.941632 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:58.965634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d36bc7-b635-494d-904f-ad6bace650c3 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:58.971770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:58.972982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:58.973674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:58.974128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] PATH_INFO: `/v3/users/36d7b059ff874d0db44ceecb2f95830c` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:58.976316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d7b059ff874d0db44ceecb2f95830c)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:58.979706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:58.990383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e9f28-a629-4910-ae3e-d0d545928573 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:58.996456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c071c2-ffcf-4420-9c0a-4aaf2f20a7ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:58.997589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c071c2-ffcf-4420-9c0a-4aaf2f20a7ca service placement] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:58.997939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c071c2-ffcf-4420-9c0a-4aaf2f20a7ca service placement] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:58.998282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c071c2-ffcf-4420-9c0a-4aaf2f20a7ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.000141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f7c071c2-ffcf-4420-9c0a-4aaf2f20a7ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:59.016964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c071c2-ffcf-4420-9c0a-4aaf2f20a7ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:59.018773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c071c2-ffcf-4420-9c0a-4aaf2f20a7ca service placement] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:59.032314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1270/2521] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:31:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:31:59.042230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d7b059ff874d0db44ceecb2f95830c'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.054676 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d7b059ff874d0db44ceecb2f95830c'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.055202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d7b059ff874d0db44ceecb2f95830c'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.070618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d7b059ff874d0db44ceecb2f95830c'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.078771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-6ee2ae92-feb4-4392-888d-05801c224420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d7b059ff874d0db44ceecb2f95830c'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.085001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1252/2522] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:31:58 2022] DELETE /identity/v3/users/36d7b059ff874d0db44ceecb2f95830c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:31:59.268255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c071c2-ffcf-4420-9c0a-4aaf2f20a7ca service placement] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:59.283337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c071c2-ffcf-4420-9c0a-4aaf2f20a7ca service placement] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:59.371947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:59.372608 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:59.372895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:59.373176 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] PATH_INFO: `/v3/projects/5099fd88fb0d40e0a5afe383f13ed5f6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.375318 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5099fd88fb0d40e0a5afe383f13ed5f6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:59.377651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:59.447569 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:59.461517 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5099fd88fb0d40e0a5afe383f13ed5f6', 'request_id': 'req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.472114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5099fd88fb0d40e0a5afe383f13ed5f6', 'request_id': 'req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.478663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5099fd88fb0d40e0a5afe383f13ed5f6', 'request_id': 'req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.492888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] The token cache is being invalidate because project 5099fd88fb0d40e0a5afe383f13ed5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:31:59.493180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.493856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8e2f5e5-dc63-4bbc-a306-f23c45e315da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:31:59.495354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1271/2523] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:31:59 2022] DELETE /identity/v3/projects/5099fd88fb0d40e0a5afe383f13ed5f6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:31:59.500793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27ce5e-df66-4d7b-8668-63e748548eca None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:59.501326 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27ce5e-df66-4d7b-8668-63e748548eca None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:59.501612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27ce5e-df66-4d7b-8668-63e748548eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.524567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-7a27ce5e-df66-4d7b-8668-63e748548eca None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:31:59.525939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7a27ce5e-df66-4d7b-8668-63e748548eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:59.592379 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:31:59.609403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1253/2524] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:31:59.616232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313de8-c856-4aee-845d-088b0a85637f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:59.616815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313de8-c856-4aee-845d-088b0a85637f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:59.617314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313de8-c856-4aee-845d-088b0a85637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.640121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-72313de8-c856-4aee-845d-088b0a85637f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:31:59.644412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-72313de8-c856-4aee-845d-088b0a85637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:31:59.655944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1272/2525] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:31:59.660264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27ce5e-df66-4d7b-8668-63e748548eca None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:59.672321 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27ce5e-df66-4d7b-8668-63e748548eca None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:59.677421 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a291b69-3557-477a-96ec-69472394426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:59.677834 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a291b69-3557-477a-96ec-69472394426b admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:59.678116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a291b69-3557-477a-96ec-69472394426b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:59.678391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a291b69-3557-477a-96ec-69472394426b admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.679037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a291b69-3557-477a-96ec-69472394426b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:31:59.679340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a291b69-3557-477a-96ec-69472394426b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:59.680974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a291b69-3557-477a-96ec-69472394426b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:59.694407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1254/2526] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:31:59.699068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313de8-c856-4aee-845d-088b0a85637f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:59.709338 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313de8-c856-4aee-845d-088b0a85637f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:59.714115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbeb0d-bee5-46b3-b037-a2910cf79081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:59.714756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbeb0d-bee5-46b3-b037-a2910cf79081 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:59.715038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbeb0d-bee5-46b3-b037-a2910cf79081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:59.715319 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbeb0d-bee5-46b3-b037-a2910cf79081 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.715982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbeb0d-bee5-46b3-b037-a2910cf79081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:59.717969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbeb0d-bee5-46b3-b037-a2910cf79081 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:59.755834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1273/2527] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:31:59 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:31:59.760194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a291b69-3557-477a-96ec-69472394426b admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:59.771622 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a291b69-3557-477a-96ec-69472394426b admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:59.848362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497b5ce-bb27-41b6-b7d8-b4557ed65c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:59.848992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b5ce-bb27-41b6-b7d8-b4557ed65c99 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:59.849316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b5ce-bb27-41b6-b7d8-b4557ed65c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:59.849605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b5ce-bb27-41b6-b7d8-b4557ed65c99 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.850237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497b5ce-bb27-41b6-b7d8-b4557ed65c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:59.852214 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497b5ce-bb27-41b6-b7d8-b4557ed65c99 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:59.880521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1255/2528] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:31:59 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:31:59.881744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbeb0d-bee5-46b3-b037-a2910cf79081 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:59.892253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbeb0d-bee5-46b3-b037-a2910cf79081 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:59.897445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47d3ee-68e6-4845-9542-84a06f25aaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:59.898058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47d3ee-68e6-4845-9542-84a06f25aaba admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:59.898337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47d3ee-68e6-4845-9542-84a06f25aaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:59.898612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47d3ee-68e6-4845-9542-84a06f25aaba admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.899254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47d3ee-68e6-4845-9542-84a06f25aaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:59.900862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47d3ee-68e6-4845-9542-84a06f25aaba admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:59.910995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1274/2529] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:31:59.915048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497b5ce-bb27-41b6-b7d8-b4557ed65c99 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:59.927921 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497b5ce-bb27-41b6-b7d8-b4557ed65c99 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:59.932587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbece43-11db-4cc0-8a51-88a1089bd53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:59.933420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbece43-11db-4cc0-8a51-88a1089bd53d admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:59.934235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbece43-11db-4cc0-8a51-88a1089bd53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:59.934511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbece43-11db-4cc0-8a51-88a1089bd53d admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.935226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbece43-11db-4cc0-8a51-88a1089bd53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:59.936731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbece43-11db-4cc0-8a51-88a1089bd53d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:31:59.948237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1256/2530] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:31:59.953065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47d3ee-68e6-4845-9542-84a06f25aaba admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:31:59.963623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47d3ee-68e6-4845-9542-84a06f25aaba admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:31:59.968975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea046fef-09ee-406a-883a-64c070be8cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:31:59.969654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea046fef-09ee-406a-883a-64c070be8cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:31:59.969947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea046fef-09ee-406a-883a-64c070be8cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:31:59.970227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea046fef-09ee-406a-883a-64c070be8cca admin admin] PATH_INFO: `/v3/projects/2f008c27bbc045f8905f2ce0b4a18ad6/users/1595e43f282b44acbb533f6b6ab5fbd9/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:31:59.989548 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea046fef-09ee-406a-883a-64c070be8cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f008c27bbc045f8905f2ce0b4a18ad6, user_id=1595e43f282b44acbb533f6b6ab5fbd9, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:31:59.992305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea046fef-09ee-406a-883a-64c070be8cca admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:00.013292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1275/2531] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:31:59 2022] PUT /identity/v3/projects/2f008c27bbc045f8905f2ce0b4a18ad6/users/1595e43f282b44acbb533f6b6ab5fbd9/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:32:00.019814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed387f-978f-4c43-b468-9a30e03ff9c5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.020107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed387f-978f-4c43-b468-9a30e03ff9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.020380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed387f-978f-4c43-b468-9a30e03ff9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.050069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f2ed387f-978f-4c43-b468-9a30e03ff9c5 None None] MFA Rules not processed for user `1595e43f282b44acbb533f6b6ab5fbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:00.051292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f2ed387f-978f-4c43-b468-9a30e03ff9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:00.135013 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1257/2532] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:00.140010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea046fef-09ee-406a-883a-64c070be8cca admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:00.208496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea046fef-09ee-406a-883a-64c070be8cca admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:00.213350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd5243-a5d8-4e44-a82a-fbe902d7f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:00.213963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd5243-a5d8-4e44-a82a-fbe902d7f29d admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.214594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd5243-a5d8-4e44-a82a-fbe902d7f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.214594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd5243-a5d8-4e44-a82a-fbe902d7f29d admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.215388 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd5243-a5d8-4e44-a82a-fbe902d7f29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:00.217072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd5243-a5d8-4e44-a82a-fbe902d7f29d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:00.246491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1276/2533] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:32:00 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:00.250401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed387f-978f-4c43-b468-9a30e03ff9c5 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:00.260935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed387f-978f-4c43-b468-9a30e03ff9c5 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:00.305411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:00.318023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d1144-0d2a-4d73-8f31-1998664856c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:00.318657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d1144-0d2a-4d73-8f31-1998664856c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.318945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d1144-0d2a-4d73-8f31-1998664856c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.319221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d1144-0d2a-4d73-8f31-1998664856c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.319862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d1144-0d2a-4d73-8f31-1998664856c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:00.321846 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d1144-0d2a-4d73-8f31-1998664856c9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:00.342675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1258/2534] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:32:00 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:00.346664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd5243-a5d8-4e44-a82a-fbe902d7f29d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:00.358127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd5243-a5d8-4e44-a82a-fbe902d7f29d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:00.363137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9656a-f180-4d1e-ab21-f147cb8cb24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:00.363742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9656a-f180-4d1e-ab21-f147cb8cb24c admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.364029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9656a-f180-4d1e-ab21-f147cb8cb24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.364560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9656a-f180-4d1e-ab21-f147cb8cb24c admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.365282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9656a-f180-4d1e-ab21-f147cb8cb24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:00.366871 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9656a-f180-4d1e-ab21-f147cb8cb24c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:00.378632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1277/2535] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:00.382913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d1144-0d2a-4d73-8f31-1998664856c9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:00.394399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d1144-0d2a-4d73-8f31-1998664856c9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:00.399275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c11cd6-790d-4084-bf63-f4bebbeec045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:00.399950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c11cd6-790d-4084-bf63-f4bebbeec045 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.400234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c11cd6-790d-4084-bf63-f4bebbeec045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.400546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c11cd6-790d-4084-bf63-f4bebbeec045 admin admin] PATH_INFO: `/v3/projects/517d3d1990fd422c81761a5382880f2f/users/d187048776004c8991f6ae96008f2fc7/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.417537 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c11cd6-790d-4084-bf63-f4bebbeec045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517d3d1990fd422c81761a5382880f2f, user_id=d187048776004c8991f6ae96008f2fc7, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:00.420380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c11cd6-790d-4084-bf63-f4bebbeec045 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:00.434173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1259/2536] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:00 2022] PUT /identity/v3/projects/517d3d1990fd422c81761a5382880f2f/users/d187048776004c8991f6ae96008f2fc7/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:00.438312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9656a-f180-4d1e-ab21-f147cb8cb24c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:00.448476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9656a-f180-4d1e-ab21-f147cb8cb24c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:00.480550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:00.510126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373e5da-cb41-416a-a67b-a1bd12591d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:00.510741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373e5da-cb41-416a-a67b-a1bd12591d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.511024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373e5da-cb41-416a-a67b-a1bd12591d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.511300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373e5da-cb41-416a-a67b-a1bd12591d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.512431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373e5da-cb41-416a-a67b-a1bd12591d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:00.514057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373e5da-cb41-416a-a67b-a1bd12591d28 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:00.523789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1278/2537] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:32:00.528646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c11cd6-790d-4084-bf63-f4bebbeec045 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:00.539015 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c11cd6-790d-4084-bf63-f4bebbeec045 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:00.543585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207e616-e287-4a13-8c5f-35179b3e6585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:00.544242 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207e616-e287-4a13-8c5f-35179b3e6585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.544503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207e616-e287-4a13-8c5f-35179b3e6585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.544774 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207e616-e287-4a13-8c5f-35179b3e6585 admin admin] PATH_INFO: `/v3/projects/517d3d1990fd422c81761a5382880f2f/users/d187048776004c8991f6ae96008f2fc7/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.546751 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207e616-e287-4a13-8c5f-35179b3e6585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517d3d1990fd422c81761a5382880f2f, user_id=d187048776004c8991f6ae96008f2fc7, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:00.549430 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207e616-e287-4a13-8c5f-35179b3e6585 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:00.559567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1260/2538] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:00 2022] PUT /identity/v3/projects/517d3d1990fd422c81761a5382880f2f/users/d187048776004c8991f6ae96008f2fc7/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:00.570723 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a40020-9aba-4107-9087-15d3c002a2ba None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.571034 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a40020-9aba-4107-9087-15d3c002a2ba None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.571311 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a40020-9aba-4107-9087-15d3c002a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.600499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a4a40020-9aba-4107-9087-15d3c002a2ba None None] MFA Rules not processed for user `d187048776004c8991f6ae96008f2fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:00.601788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a4a40020-9aba-4107-9087-15d3c002a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:00.670533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1279/2539] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:00.681678 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207e616-e287-4a13-8c5f-35179b3e6585 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:00.683392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a207e616-e287-4a13-8c5f-35179b3e6585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:00.740634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207e616-e287-4a13-8c5f-35179b3e6585 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:00.744273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990b123-377a-43fb-86df-2e6e8d8d3a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:00.744875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990b123-377a-43fb-86df-2e6e8d8d3a51 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.745176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990b123-377a-43fb-86df-2e6e8d8d3a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.745479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990b123-377a-43fb-86df-2e6e8d8d3a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.755131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990b123-377a-43fb-86df-2e6e8d8d3a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:00.756589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990b123-377a-43fb-86df-2e6e8d8d3a51 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:00.766684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1261/2540] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:00.849578 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a40020-9aba-4107-9087-15d3c002a2ba None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:00.859352 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a40020-9aba-4107-9087-15d3c002a2ba None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:00.863033 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b8a12-c822-4feb-be6c-ad1f6bb61f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:00.863645 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b8a12-c822-4feb-be6c-ad1f6bb61f55 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:00.863911 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b8a12-c822-4feb-be6c-ad1f6bb61f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:00.864439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b8a12-c822-4feb-be6c-ad1f6bb61f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:00.919304 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b8a12-c822-4feb-be6c-ad1f6bb61f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:00.920738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b8a12-c822-4feb-be6c-ad1f6bb61f55 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:00.929793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1280/2541] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:06.138047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179a638-4909-4c0b-a9d5-dde254a9bad0 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:06.138512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179a638-4909-4c0b-a9d5-dde254a9bad0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:06.138609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179a638-4909-4c0b-a9d5-dde254a9bad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:06.157369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6179a638-4909-4c0b-a9d5-dde254a9bad0 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:06.158566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6179a638-4909-4c0b-a9d5-dde254a9bad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:06.212464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1262/2542] 10.222.0.61 () {58 vars in 967 bytes} [Thu Sep 22 18:32:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:06.259038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b8a12-c822-4feb-be6c-ad1f6bb61f55 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:06.260463 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-814b8a12-c822-4feb-be6c-ad1f6bb61f55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:06.318004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:06.335892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b8a12-c822-4feb-be6c-ad1f6bb61f55 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:06.340868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bd0d5-e190-41b2-9c27-f3c1f83b456c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:06.341512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bd0d5-e190-41b2-9c27-f3c1f83b456c service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:06.341794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bd0d5-e190-41b2-9c27-f3c1f83b456c service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:06.342069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bd0d5-e190-41b2-9c27-f3c1f83b456c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:06.350144 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bd0d5-e190-41b2-9c27-f3c1f83b456c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:06.351762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bd0d5-e190-41b2-9c27-f3c1f83b456c service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:06.360688 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1281/2543] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:32:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:32:07.773517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179a638-4909-4c0b-a9d5-dde254a9bad0 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:07.827802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:07.842562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179a638-4909-4c0b-a9d5-dde254a9bad0 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:07.847075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:07.847713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:07.847993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:07.848280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] PATH_INFO: `/v3/users/1595e43f282b44acbb533f6b6ab5fbd9` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:07.850528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1595e43f282b44acbb533f6b6ab5fbd9)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:07.851376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:07.905510 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1595e43f282b44acbb533f6b6ab5fbd9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:07.913116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1595e43f282b44acbb533f6b6ab5fbd9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:07.913903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1595e43f282b44acbb533f6b6ab5fbd9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:07.930102 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1595e43f282b44acbb533f6b6ab5fbd9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:07.938665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1595e43f282b44acbb533f6b6ab5fbd9'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:07.945273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1263/2544] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:07 2022] DELETE /identity/v3/users/1595e43f282b44acbb533f6b6ab5fbd9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:07.949880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd736a-7f4e-4f5d-b4f3-35094230a5b8 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:07.950415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd736a-7f4e-4f5d-b4f3-35094230a5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:07.950415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd736a-7f4e-4f5d-b4f3-35094230a5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:07.969860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-f8bd736a-7f4e-4f5d-b4f3-35094230a5b8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:07.971099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f8bd736a-7f4e-4f5d-b4f3-35094230a5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:08.034912 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1282/2545] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:08.045180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:08.046646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:08.112149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a227b-48a8-4625-838e-452efe0d1ef7 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:08.116589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32c41-44da-4c97-aeb7-e12b7a07eeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:08.117208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32c41-44da-4c97-aeb7-e12b7a07eeae service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:08.117820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32c41-44da-4c97-aeb7-e12b7a07eeae service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:08.117820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32c41-44da-4c97-aeb7-e12b7a07eeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:08.128684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32c41-44da-4c97-aeb7-e12b7a07eeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:08.130224 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32c41-44da-4c97-aeb7-e12b7a07eeae service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:08.140417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1264/2546] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:08.443278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd736a-7f4e-4f5d-b4f3-35094230a5b8 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:08.444820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f8bd736a-7f4e-4f5d-b4f3-35094230a5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:08.458279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd736a-7f4e-4f5d-b4f3-35094230a5b8 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:08.462966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:08.463852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:08.464142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:08.464423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] PATH_INFO: `/v3/projects/2f008c27bbc045f8905f2ce0b4a18ad6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:08.465633 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f008c27bbc045f8905f2ce0b4a18ad6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:08.467586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:08.519576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f008c27bbc045f8905f2ce0b4a18ad6', 'request_id': 'req-df50dae3-978e-4699-bfd8-ac6c13e903ff'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.526586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f008c27bbc045f8905f2ce0b4a18ad6', 'request_id': 'req-df50dae3-978e-4699-bfd8-ac6c13e903ff'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.533920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f008c27bbc045f8905f2ce0b4a18ad6', 'request_id': 'req-df50dae3-978e-4699-bfd8-ac6c13e903ff'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.551972 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] The token cache is being invalidate because project 2f008c27bbc045f8905f2ce0b4a18ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:08.552269 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.553436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.559206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1283/2547] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:08 2022] DELETE /identity/v3/projects/2f008c27bbc045f8905f2ce0b4a18ad6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:08.559648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32c41-44da-4c97-aeb7-e12b7a07eeae service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:08.573431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32c41-44da-4c97-aeb7-e12b7a07eeae service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:08.643263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:08.643922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:08.644194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:08.644471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] PATH_INFO: `/v3/users/d187048776004c8991f6ae96008f2fc7` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:08.645640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d187048776004c8991f6ae96008f2fc7)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:08.647564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:08.665161 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:08.710335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd187048776004c8991f6ae96008f2fc7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.718236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd187048776004c8991f6ae96008f2fc7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.718912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd187048776004c8991f6ae96008f2fc7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.738470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd187048776004c8991f6ae96008f2fc7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.747234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-8118f298-2516-4976-9887-d6ec7bc6e11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd187048776004c8991f6ae96008f2fc7'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:08.755883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1265/2548] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:08 2022] DELETE /identity/v3/users/d187048776004c8991f6ae96008f2fc7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:09.281516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:09.283864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:09.301265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50dae3-978e-4699-bfd8-ac6c13e903ff admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:09.363467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:09.364226 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:09.364803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:09.365082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] PATH_INFO: `/v3/projects/517d3d1990fd422c81761a5382880f2f` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:09.366247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=517d3d1990fd422c81761a5382880f2f)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:09.368200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:09.376536 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:09.421550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517d3d1990fd422c81761a5382880f2f', 'request_id': 'req-63b709e9-737e-4d2a-a3b3-38eebe5eef44'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:09.428043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517d3d1990fd422c81761a5382880f2f', 'request_id': 'req-63b709e9-737e-4d2a-a3b3-38eebe5eef44'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:09.434359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517d3d1990fd422c81761a5382880f2f', 'request_id': 'req-63b709e9-737e-4d2a-a3b3-38eebe5eef44'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:09.446894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] The token cache is being invalidate because project 517d3d1990fd422c81761a5382880f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:09.447264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:09.447959 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-63b709e9-737e-4d2a-a3b3-38eebe5eef44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:09.450007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1284/2549] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:09 2022] DELETE /identity/v3/projects/517d3d1990fd422c81761a5382880f2f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:09.454962 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738702-d9f4-43a0-88b9-2b83fbf3774b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:09.455433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738702-d9f4-43a0-88b9-2b83fbf3774b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:09.455551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738702-d9f4-43a0-88b9-2b83fbf3774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:09.476979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-78738702-d9f4-43a0-88b9-2b83fbf3774b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:09.478599 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-78738702-d9f4-43a0-88b9-2b83fbf3774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:09.547885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1266/2550] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:32:09.555708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b2a6-0224-4cbd-825f-2c0feba96cde None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:09.555996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b2a6-0224-4cbd-825f-2c0feba96cde None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:09.556275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b2a6-0224-4cbd-825f-2c0feba96cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:09.577266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ad56b2a6-0224-4cbd-825f-2c0feba96cde None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:09.578417 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ad56b2a6-0224-4cbd-825f-2c0feba96cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:09.586685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1285/2551] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:09.593028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78738702-d9f4-43a0-88b9-2b83fbf3774b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:09.604316 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78738702-d9f4-43a0-88b9-2b83fbf3774b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:09.609621 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b340-306e-4cf3-aff8-388668222ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:09.610392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b340-306e-4cf3-aff8-388668222ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:09.610796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b340-306e-4cf3-aff8-388668222ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:09.611172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b340-306e-4cf3-aff8-388668222ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:09.611986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b340-306e-4cf3-aff8-388668222ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:32:09.612390 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b340-306e-4cf3-aff8-388668222ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:09.614260 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b340-306e-4cf3-aff8-388668222ac8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:09.629475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1267/2552] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:32:09.634605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b2a6-0224-4cbd-825f-2c0feba96cde None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:09.647686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b2a6-0224-4cbd-825f-2c0feba96cde None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:09.654503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0644a-d362-4c26-b4c5-786a4c766e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:09.655410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0644a-d362-4c26-b4c5-786a4c766e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:09.655895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0644a-d362-4c26-b4c5-786a4c766e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:09.656378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0644a-d362-4c26-b4c5-786a4c766e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:09.657109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0644a-d362-4c26-b4c5-786a4c766e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:09.661867 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0644a-d362-4c26-b4c5-786a4c766e77 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:09.693052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1286/2553] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:32:09 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:32:09.697887 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b340-306e-4cf3-aff8-388668222ac8 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:09.710290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b340-306e-4cf3-aff8-388668222ac8 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:09.786554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760e6b0-35a4-4c31-b495-1039ddcfae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:09.787194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760e6b0-35a4-4c31-b495-1039ddcfae4d admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:09.787484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760e6b0-35a4-4c31-b495-1039ddcfae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:09.787763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760e6b0-35a4-4c31-b495-1039ddcfae4d admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:09.788409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760e6b0-35a4-4c31-b495-1039ddcfae4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:09.790427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760e6b0-35a4-4c31-b495-1039ddcfae4d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:09.817433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1268/2554] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:32:09 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:09.821680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0644a-d362-4c26-b4c5-786a4c766e77 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:09.833554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0644a-d362-4c26-b4c5-786a4c766e77 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:09.840511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e23dd-ea3c-4622-b2ac-430e104ecac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:09.852868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e23dd-ea3c-4622-b2ac-430e104ecac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:09.853263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e23dd-ea3c-4622-b2ac-430e104ecac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:09.853704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e23dd-ea3c-4622-b2ac-430e104ecac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:09.854397 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e23dd-ea3c-4622-b2ac-430e104ecac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:09.856130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e23dd-ea3c-4622-b2ac-430e104ecac3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:09.870224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1287/2555] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:32:09.875588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760e6b0-35a4-4c31-b495-1039ddcfae4d admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:09.889570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760e6b0-35a4-4c31-b495-1039ddcfae4d admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:09.901081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433384e9-5ecc-44a1-8920-8685e2e5c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:09.902097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433384e9-5ecc-44a1-8920-8685e2e5c885 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:09.902192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433384e9-5ecc-44a1-8920-8685e2e5c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:09.902543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433384e9-5ecc-44a1-8920-8685e2e5c885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:09.903317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433384e9-5ecc-44a1-8920-8685e2e5c885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:09.906679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433384e9-5ecc-44a1-8920-8685e2e5c885 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:09.908449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:09.925797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1269/2556] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:32:09.927013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e23dd-ea3c-4622-b2ac-430e104ecac3 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:09.946586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e23dd-ea3c-4622-b2ac-430e104ecac3 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:09.952758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18085689-fa43-4dfe-9bd2-a21a482d5a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:09.953487 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18085689-fa43-4dfe-9bd2-a21a482d5a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:09.953778 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18085689-fa43-4dfe-9bd2-a21a482d5a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:09.954102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18085689-fa43-4dfe-9bd2-a21a482d5a5f admin admin] PATH_INFO: `/v3/projects/495ad858ccd54102bb3412fed64d25fb/users/b4ba5956a734474ab801728051ae9b79/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:09.971347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18085689-fa43-4dfe-9bd2-a21a482d5a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=495ad858ccd54102bb3412fed64d25fb, user_id=b4ba5956a734474ab801728051ae9b79, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:09.974167 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18085689-fa43-4dfe-9bd2-a21a482d5a5f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:09.989772 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1288/2557] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:09 2022] PUT /identity/v3/projects/495ad858ccd54102bb3412fed64d25fb/users/b4ba5956a734474ab801728051ae9b79/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:10.001940 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b5328-8734-4cca-b4e5-708e664d46a5 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:10.002201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b5328-8734-4cca-b4e5-708e664d46a5 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:10.002477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b5328-8734-4cca-b4e5-708e664d46a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:10.039495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-598b5328-8734-4cca-b4e5-708e664d46a5 None None] MFA Rules not processed for user `b4ba5956a734474ab801728051ae9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:10.040922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-598b5328-8734-4cca-b4e5-708e664d46a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:10.147089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1270/2558] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:10.151896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18085689-fa43-4dfe-9bd2-a21a482d5a5f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:10.250439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18085689-fa43-4dfe-9bd2-a21a482d5a5f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:10.256257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888568b-1ee2-4ab2-b706-b9a4fe08c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:10.257110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888568b-1ee2-4ab2-b706-b9a4fe08c31e admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:10.257323 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888568b-1ee2-4ab2-b706-b9a4fe08c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:10.257473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888568b-1ee2-4ab2-b706-b9a4fe08c31e admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:10.258148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888568b-1ee2-4ab2-b706-b9a4fe08c31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:10.260124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888568b-1ee2-4ab2-b706-b9a4fe08c31e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:10.289422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1289/2559] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:32:10 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:32:10.295190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b5328-8734-4cca-b4e5-708e664d46a5 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:10.306541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b5328-8734-4cca-b4e5-708e664d46a5 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:10.373574 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80c9e0-bcb9-4703-b830-3acde3974fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:10.374105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80c9e0-bcb9-4703-b830-3acde3974fac admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:10.374395 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80c9e0-bcb9-4703-b830-3acde3974fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:10.374670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80c9e0-bcb9-4703-b830-3acde3974fac admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:10.375307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80c9e0-bcb9-4703-b830-3acde3974fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:10.377328 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80c9e0-bcb9-4703-b830-3acde3974fac admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:10.399980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1271/2560] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:32:10 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:32:10.404347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888568b-1ee2-4ab2-b706-b9a4fe08c31e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:10.416145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888568b-1ee2-4ab2-b706-b9a4fe08c31e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:10.421881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60d20-8201-4c95-bc93-ffe838c1bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:10.422523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60d20-8201-4c95-bc93-ffe838c1bd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:10.422809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60d20-8201-4c95-bc93-ffe838c1bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:10.423087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60d20-8201-4c95-bc93-ffe838c1bd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:10.423739 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf60d20-8201-4c95-bc93-ffe838c1bd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:10.425375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf60d20-8201-4c95-bc93-ffe838c1bd52 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:10.437795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1290/2561] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:10.441986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80c9e0-bcb9-4703-b830-3acde3974fac admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:10.452158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80c9e0-bcb9-4703-b830-3acde3974fac admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:10.456866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b636f-33ce-4df3-b639-3acd5dfa7b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:10.457681 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b636f-33ce-4df3-b639-3acd5dfa7b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:10.457965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b636f-33ce-4df3-b639-3acd5dfa7b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:10.458248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b636f-33ce-4df3-b639-3acd5dfa7b09 admin admin] PATH_INFO: `/v3/projects/1662cfab568f487d8e684046d8810cd6/users/ca175744af5e41d08cb4143b573e78c8/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:10.474386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b636f-33ce-4df3-b639-3acd5dfa7b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1662cfab568f487d8e684046d8810cd6, user_id=ca175744af5e41d08cb4143b573e78c8, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:10.477049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b636f-33ce-4df3-b639-3acd5dfa7b09 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:10.492047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1272/2562] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:10 2022] PUT /identity/v3/projects/1662cfab568f487d8e684046d8810cd6/users/ca175744af5e41d08cb4143b573e78c8/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:32:10.496080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60d20-8201-4c95-bc93-ffe838c1bd52 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:10.506129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60d20-8201-4c95-bc93-ffe838c1bd52 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:10.509706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:10.567801 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f29f-1924-4263-8f1b-b0a5c8e8fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:10.568416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f29f-1924-4263-8f1b-b0a5c8e8fd84 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:10.568698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f29f-1924-4263-8f1b-b0a5c8e8fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:10.568981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f29f-1924-4263-8f1b-b0a5c8e8fd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:10.569656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556f29f-1924-4263-8f1b-b0a5c8e8fd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:10.571272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556f29f-1924-4263-8f1b-b0a5c8e8fd84 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:10.581117 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1291/2563] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:10.585387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b636f-33ce-4df3-b639-3acd5dfa7b09 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:10.596600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b636f-33ce-4df3-b639-3acd5dfa7b09 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:10.603234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842977f-a1f5-44fe-ad2c-4ad2bf4284f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:10.604338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842977f-a1f5-44fe-ad2c-4ad2bf4284f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:10.604736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842977f-a1f5-44fe-ad2c-4ad2bf4284f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:10.605027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842977f-a1f5-44fe-ad2c-4ad2bf4284f4 admin admin] PATH_INFO: `/v3/projects/1662cfab568f487d8e684046d8810cd6/users/ca175744af5e41d08cb4143b573e78c8/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:10.607689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842977f-a1f5-44fe-ad2c-4ad2bf4284f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1662cfab568f487d8e684046d8810cd6, user_id=ca175744af5e41d08cb4143b573e78c8, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:10.610381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842977f-a1f5-44fe-ad2c-4ad2bf4284f4 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:10.622104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1273/2564] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:10 2022] PUT /identity/v3/projects/1662cfab568f487d8e684046d8810cd6/users/ca175744af5e41d08cb4143b573e78c8/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:10.632209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed31dd0-a750-4fdc-ad88-833e89be19a1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:10.632427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed31dd0-a750-4fdc-ad88-833e89be19a1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:10.632721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed31dd0-a750-4fdc-ad88-833e89be19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:10.661448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-7ed31dd0-a750-4fdc-ad88-833e89be19a1 None None] MFA Rules not processed for user `ca175744af5e41d08cb4143b573e78c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:10.662681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7ed31dd0-a750-4fdc-ad88-833e89be19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:10.738336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1292/2565] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:10.749347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842977f-a1f5-44fe-ad2c-4ad2bf4284f4 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:10.751062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1842977f-a1f5-44fe-ad2c-4ad2bf4284f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:10.795165 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:10.811627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842977f-a1f5-44fe-ad2c-4ad2bf4284f4 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:10.815280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019681-aaab-42de-98a4-34b9c2fa16dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:10.815892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019681-aaab-42de-98a4-34b9c2fa16dc service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:10.816175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019681-aaab-42de-98a4-34b9c2fa16dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:10.816450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019681-aaab-42de-98a4-34b9c2fa16dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:10.875728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b019681-aaab-42de-98a4-34b9c2fa16dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:10.877187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b019681-aaab-42de-98a4-34b9c2fa16dc service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:10.886398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1274/2566] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:13.475331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed31dd0-a750-4fdc-ad88-833e89be19a1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:13.476870 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7ed31dd0-a750-4fdc-ad88-833e89be19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:13.540988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019681-aaab-42de-98a4-34b9c2fa16dc service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:13.549188 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed31dd0-a750-4fdc-ad88-833e89be19a1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:13.550272 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019681-aaab-42de-98a4-34b9c2fa16dc service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:13.553677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:13.554229 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185606a6-7ee7-4e26-9d5b-5129ed3a0b78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:13.554346 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:13.554583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:13.555139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] PATH_INFO: `/v3/users/bc4e92db52d54f6ea2dc2184760c6500` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:13.555264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185606a6-7ee7-4e26-9d5b-5129ed3a0b78 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:13.555264 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185606a6-7ee7-4e26-9d5b-5129ed3a0b78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:13.555602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185606a6-7ee7-4e26-9d5b-5129ed3a0b78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:13.556066 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4e92db52d54f6ea2dc2184760c6500)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:13.558921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:13.565983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185606a6-7ee7-4e26-9d5b-5129ed3a0b78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:13.567491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185606a6-7ee7-4e26-9d5b-5129ed3a0b78 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:13.577822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1275/2567] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:13.598216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:13.614834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4e92db52d54f6ea2dc2184760c6500'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:13.623265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4e92db52d54f6ea2dc2184760c6500'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:13.623901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4e92db52d54f6ea2dc2184760c6500'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:13.637365 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4e92db52d54f6ea2dc2184760c6500'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:13.644815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4e92db52d54f6ea2dc2184760c6500'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:13.650830 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1293/2568] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:13 2022] DELETE /identity/v3/users/bc4e92db52d54f6ea2dc2184760c6500 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:13.843213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185606a6-7ee7-4e26-9d5b-5129ed3a0b78 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:13.864152 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185606a6-7ee7-4e26-9d5b-5129ed3a0b78 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:13.945592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:13.946241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:13.946532 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:13.946810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] PATH_INFO: `/v3/projects/996e900bf9874f31b00a3a0f53630e8d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:13.947943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=996e900bf9874f31b00a3a0f53630e8d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:13.949943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:13.998869 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996e900bf9874f31b00a3a0f53630e8d', 'request_id': 'req-027f02c9-e595-4b09-8946-04a41e12e42e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.006035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996e900bf9874f31b00a3a0f53630e8d', 'request_id': 'req-027f02c9-e595-4b09-8946-04a41e12e42e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.012168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996e900bf9874f31b00a3a0f53630e8d', 'request_id': 'req-027f02c9-e595-4b09-8946-04a41e12e42e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.023168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] The token cache is being invalidate because project 996e900bf9874f31b00a3a0f53630e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:14.023459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.024089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.025670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1276/2569] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:13 2022] DELETE /identity/v3/projects/996e900bf9874f31b00a3a0f53630e8d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:14.029644 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:14.031054 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:14.044380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e022e-4ccb-44db-b853-85e811a8481c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:14.101003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:14.101719 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:14.102065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:14.102382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] PATH_INFO: `/v3/users/0375d31fc2b44d42888dbbbabdcbe5b3` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:14.103594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0375d31fc2b44d42888dbbbabdcbe5b3)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:14.106214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:14.161940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0375d31fc2b44d42888dbbbabdcbe5b3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.170315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0375d31fc2b44d42888dbbbabdcbe5b3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.170950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0375d31fc2b44d42888dbbbabdcbe5b3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.184358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0375d31fc2b44d42888dbbbabdcbe5b3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.191737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0375d31fc2b44d42888dbbbabdcbe5b3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.197994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1294/2570] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:14 2022] DELETE /identity/v3/users/0375d31fc2b44d42888dbbbabdcbe5b3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:14.377519 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:14.378971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:14.391689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f02c9-e595-4b09-8946-04a41e12e42e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:14.396595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:14.451726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:14.452402 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:14.452688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:14.453354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] PATH_INFO: `/v3/projects/7e13202c2fb846589ddfcc6ccb09d95e` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:14.454552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e13202c2fb846589ddfcc6ccb09d95e)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:14.456490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:14.502163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e13202c2fb846589ddfcc6ccb09d95e', 'request_id': 'req-83086036-2ef4-47b6-abc4-5ea24a664ef6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.509389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e13202c2fb846589ddfcc6ccb09d95e', 'request_id': 'req-83086036-2ef4-47b6-abc4-5ea24a664ef6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.515033 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e13202c2fb846589ddfcc6ccb09d95e', 'request_id': 'req-83086036-2ef4-47b6-abc4-5ea24a664ef6'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.526164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] The token cache is being invalidate because project 7e13202c2fb846589ddfcc6ccb09d95e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:14.526476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.527118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-83086036-2ef4-47b6-abc4-5ea24a664ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:14.529130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1277/2571] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:14 2022] DELETE /identity/v3/projects/7e13202c2fb846589ddfcc6ccb09d95e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:24.194490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=71,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:24.523171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:26.078173 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:26.079587 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:26.092280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed740ebe-31c8-4246-98f9-e047c0a148e7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:26.148106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:26.148738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:26.149011 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:26.149314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] PATH_INFO: `/v3/users/b4ba5956a734474ab801728051ae9b79` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:26.150418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ba5956a734474ab801728051ae9b79)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:26.152331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:26.198564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ba5956a734474ab801728051ae9b79'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.205933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ba5956a734474ab801728051ae9b79'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.206601 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ba5956a734474ab801728051ae9b79'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.219087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ba5956a734474ab801728051ae9b79'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.226066 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ba5956a734474ab801728051ae9b79'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.231952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1295/2572] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:26 2022] DELETE /identity/v3/users/b4ba5956a734474ab801728051ae9b79 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:26.236416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aea69-304d-475f-9eab-75e4307be2df None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:26.236893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aea69-304d-475f-9eab-75e4307be2df None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:26.236994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aea69-304d-475f-9eab-75e4307be2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:26.256517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-bf2aea69-304d-475f-9eab-75e4307be2df None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:26.257831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bf2aea69-304d-475f-9eab-75e4307be2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:26.315398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1278/2573] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:26.326331 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:26.327803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:26.388019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c893fc-c318-4fb8-8e0f-978b72431c70 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:26.391631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496b6e-5c3a-4e91-a071-cab10b51156d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:26.392235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496b6e-5c3a-4e91-a071-cab10b51156d service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:26.392516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496b6e-5c3a-4e91-a071-cab10b51156d service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:26.392821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496b6e-5c3a-4e91-a071-cab10b51156d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:26.401857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6496b6e-5c3a-4e91-a071-cab10b51156d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:26.403327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6496b6e-5c3a-4e91-a071-cab10b51156d service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:26.412909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1296/2574] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:32:26.677898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aea69-304d-475f-9eab-75e4307be2df None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:26.679569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bf2aea69-304d-475f-9eab-75e4307be2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:26.693802 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aea69-304d-475f-9eab-75e4307be2df None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:26.698413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:26.699047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:26.699327 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:26.699630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] PATH_INFO: `/v3/projects/495ad858ccd54102bb3412fed64d25fb` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:26.700743 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=495ad858ccd54102bb3412fed64d25fb)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:26.702674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:26.751130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495ad858ccd54102bb3412fed64d25fb', 'request_id': 'req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.758665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495ad858ccd54102bb3412fed64d25fb', 'request_id': 'req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.764227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495ad858ccd54102bb3412fed64d25fb', 'request_id': 'req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.775828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] The token cache is being invalidate because project 495ad858ccd54102bb3412fed64d25fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:26.776147 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.776781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.778398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1279/2575] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:26 2022] DELETE /identity/v3/projects/495ad858ccd54102bb3412fed64d25fb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:26.782450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496b6e-5c3a-4e91-a071-cab10b51156d service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:26.792213 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496b6e-5c3a-4e91-a071-cab10b51156d service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:26.812427 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:26.853837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:26.854394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:26.854702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:26.854980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] PATH_INFO: `/v3/users/ca175744af5e41d08cb4143b573e78c8` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:26.856119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca175744af5e41d08cb4143b573e78c8)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:26.858150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:26.904794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca175744af5e41d08cb4143b573e78c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.912118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca175744af5e41d08cb4143b573e78c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.912729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca175744af5e41d08cb4143b573e78c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.924663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca175744af5e41d08cb4143b573e78c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.931460 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-fa416a4d-c01b-4f43-b03f-008a245088c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca175744af5e41d08cb4143b573e78c8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:26.937741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1297/2576] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:26 2022] DELETE /identity/v3/users/ca175744af5e41d08cb4143b573e78c8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:27.204284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:27.206084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:27.221801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca68053-daf3-4ba4-8eae-9ba9f85c71ba admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:27.280230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:27.280904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.281189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.281521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] PATH_INFO: `/v3/projects/1662cfab568f487d8e684046d8810cd6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.282640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1662cfab568f487d8e684046d8810cd6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:27.284605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:27.315507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:27.334103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1662cfab568f487d8e684046d8810cd6', 'request_id': 'req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:27.341476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1662cfab568f487d8e684046d8810cd6', 'request_id': 'req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:27.347125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1662cfab568f487d8e684046d8810cd6', 'request_id': 'req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:27.358996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] The token cache is being invalidate because project 1662cfab568f487d8e684046d8810cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:27.359293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:27.359939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37bf4b5b-1cca-410b-9a1d-711ad43cd04c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:27.361476 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1280/2577] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:27 2022] DELETE /identity/v3/projects/1662cfab568f487d8e684046d8810cd6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:27.366617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3da792-250f-4f55-a5dc-02681580c8b8 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.367114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3da792-250f-4f55-a5dc-02681580c8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.367223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3da792-250f-4f55-a5dc-02681580c8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.387087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ad3da792-250f-4f55-a5dc-02681580c8b8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:27.388198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ad3da792-250f-4f55-a5dc-02681580c8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:27.445896 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1298/2578] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:27.454731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9451e48-1033-4175-97b9-fe6cc5ec51a6 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.455023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9451e48-1033-4175-97b9-fe6cc5ec51a6 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.455304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9451e48-1033-4175-97b9-fe6cc5ec51a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.474740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b9451e48-1033-4175-97b9-fe6cc5ec51a6 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:27.475950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b9451e48-1033-4175-97b9-fe6cc5ec51a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:27.484350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1281/2579] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:27.488435 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3da792-250f-4f55-a5dc-02681580c8b8 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:27.498946 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3da792-250f-4f55-a5dc-02681580c8b8 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:27.503468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a7e42-602c-467d-b3f5-de7fee719b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:27.504058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a7e42-602c-467d-b3f5-de7fee719b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.504336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a7e42-602c-467d-b3f5-de7fee719b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.504607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a7e42-602c-467d-b3f5-de7fee719b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.505266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a7e42-602c-467d-b3f5-de7fee719b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:32:27.505584 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a7e42-602c-467d-b3f5-de7fee719b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:27.507157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a7e42-602c-467d-b3f5-de7fee719b3e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:27.518448 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1299/2580] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:32:27.522558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9451e48-1033-4175-97b9-fe6cc5ec51a6 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:27.532350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9451e48-1033-4175-97b9-fe6cc5ec51a6 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:27.537113 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668abef-980b-4bfd-aa36-1d814c76982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:27.537761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668abef-980b-4bfd-aa36-1d814c76982c admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.538048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668abef-980b-4bfd-aa36-1d814c76982c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.538321 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668abef-980b-4bfd-aa36-1d814c76982c admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.538953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668abef-980b-4bfd-aa36-1d814c76982c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:27.540860 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668abef-980b-4bfd-aa36-1d814c76982c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:27.568773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1282/2581] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:32:27 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:27.572853 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a7e42-602c-467d-b3f5-de7fee719b3e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:27.582820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a7e42-602c-467d-b3f5-de7fee719b3e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:27.608650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:27.640407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b8a7-dabf-4eb6-9fbd-327d4f7e08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:27.640940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b8a7-dabf-4eb6-9fbd-327d4f7e08b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.641224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b8a7-dabf-4eb6-9fbd-327d4f7e08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.641540 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b8a7-dabf-4eb6-9fbd-327d4f7e08b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.642169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900b8a7-dabf-4eb6-9fbd-327d4f7e08b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:27.644071 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900b8a7-dabf-4eb6-9fbd-327d4f7e08b9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:27.664531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1300/2582] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:32:27 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:27.669155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668abef-980b-4bfd-aa36-1d814c76982c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:27.679720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668abef-980b-4bfd-aa36-1d814c76982c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:27.684966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb61cc5-bdee-4e66-8431-c31f24747702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:27.685607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb61cc5-bdee-4e66-8431-c31f24747702 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.685911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb61cc5-bdee-4e66-8431-c31f24747702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.686182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb61cc5-bdee-4e66-8431-c31f24747702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.686819 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb61cc5-bdee-4e66-8431-c31f24747702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:27.688407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb61cc5-bdee-4e66-8431-c31f24747702 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:27.698175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1283/2583] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:27.702256 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b8a7-dabf-4eb6-9fbd-327d4f7e08b9 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:27.712445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b8a7-dabf-4eb6-9fbd-327d4f7e08b9 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:27.717562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b13e55-984e-463f-bf83-28bbba11a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:27.718158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b13e55-984e-463f-bf83-28bbba11a432 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.718440 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b13e55-984e-463f-bf83-28bbba11a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.718716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b13e55-984e-463f-bf83-28bbba11a432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.719363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b13e55-984e-463f-bf83-28bbba11a432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:27.720928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b13e55-984e-463f-bf83-28bbba11a432 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:27.731993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1301/2584] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:27.735994 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb61cc5-bdee-4e66-8431-c31f24747702 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:27.746234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb61cc5-bdee-4e66-8431-c31f24747702 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:27.750901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c0e96-854d-4113-bf8a-99a2ea536326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:27.751573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0e96-854d-4113-bf8a-99a2ea536326 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.751861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0e96-854d-4113-bf8a-99a2ea536326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.752137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0e96-854d-4113-bf8a-99a2ea536326 admin admin] PATH_INFO: `/v3/projects/e11d3277dd054c8c9ceb88e103be5788/users/90fc68ff8b2848d9870473507f62fa18/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.766583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c0e96-854d-4113-bf8a-99a2ea536326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11d3277dd054c8c9ceb88e103be5788, user_id=90fc68ff8b2848d9870473507f62fa18, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:27.769265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c0e96-854d-4113-bf8a-99a2ea536326 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:27.782541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1284/2585] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:27 2022] PUT /identity/v3/projects/e11d3277dd054c8c9ceb88e103be5788/users/90fc68ff8b2848d9870473507f62fa18/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:27.792749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9b52-0e78-4ff4-a420-e1ded5305cbf None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.793039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9b52-0e78-4ff4-a420-e1ded5305cbf None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.793978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba9b52-0e78-4ff4-a420-e1ded5305cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.821456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a5ba9b52-0e78-4ff4-a420-e1ded5305cbf None None] MFA Rules not processed for user `90fc68ff8b2848d9870473507f62fa18`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:27.822663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a5ba9b52-0e78-4ff4-a420-e1ded5305cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:27.886494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1302/2586] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:27.891104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c0e96-854d-4113-bf8a-99a2ea536326 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:27.952961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c0e96-854d-4113-bf8a-99a2ea536326 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:27.957584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5554a9-ce5e-4829-a286-2bcb9386ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:27.958188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5554a9-ce5e-4829-a286-2bcb9386ed24 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:27.958466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5554a9-ce5e-4829-a286-2bcb9386ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:27.958736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5554a9-ce5e-4829-a286-2bcb9386ed24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:27.959373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5554a9-ce5e-4829-a286-2bcb9386ed24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:27.961318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5554a9-ce5e-4829-a286-2bcb9386ed24 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:27.988256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1285/2587] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:32:27 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:32:27.992639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba9b52-0e78-4ff4-a420-e1ded5305cbf None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:28.003202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba9b52-0e78-4ff4-a420-e1ded5305cbf None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:28.060357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24c8e7-d4f7-4115-955b-c0533ed1daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:28.061004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24c8e7-d4f7-4115-955b-c0533ed1daa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:28.061319 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24c8e7-d4f7-4115-955b-c0533ed1daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:28.061603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24c8e7-d4f7-4115-955b-c0533ed1daa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:28.062246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24c8e7-d4f7-4115-955b-c0533ed1daa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:28.064252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24c8e7-d4f7-4115-955b-c0533ed1daa2 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:28.086043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1303/2588] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:32:27 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:32:28.089941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5554a9-ce5e-4829-a286-2bcb9386ed24 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:28.100527 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5554a9-ce5e-4829-a286-2bcb9386ed24 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:28.105079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abcfee-cf3b-4e4d-abe3-ead99905a991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:28.105712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abcfee-cf3b-4e4d-abe3-ead99905a991 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:28.106504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abcfee-cf3b-4e4d-abe3-ead99905a991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:28.106775 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abcfee-cf3b-4e4d-abe3-ead99905a991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:28.107406 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abcfee-cf3b-4e4d-abe3-ead99905a991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:28.108990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abcfee-cf3b-4e4d-abe3-ead99905a991 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:28.120508 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1286/2589] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:28.124627 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24c8e7-d4f7-4115-955b-c0533ed1daa2 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:28.134570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24c8e7-d4f7-4115-955b-c0533ed1daa2 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:28.139710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5650-b91a-4563-a687-c29a5c37b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:28.140356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5650-b91a-4563-a687-c29a5c37b4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:28.140638 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5650-b91a-4563-a687-c29a5c37b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:28.140916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5650-b91a-4563-a687-c29a5c37b4fc admin admin] PATH_INFO: `/v3/projects/83ca0a5ff1aa44789969bf3e47a1f99d/users/159cd11fec1c4e97a580bf80f58c3205/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:28.155966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff5650-b91a-4563-a687-c29a5c37b4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ca0a5ff1aa44789969bf3e47a1f99d, user_id=159cd11fec1c4e97a580bf80f58c3205, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:28.158581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff5650-b91a-4563-a687-c29a5c37b4fc admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:28.170790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1304/2590] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:28 2022] PUT /identity/v3/projects/83ca0a5ff1aa44789969bf3e47a1f99d/users/159cd11fec1c4e97a580bf80f58c3205/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:28.174671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abcfee-cf3b-4e4d-abe3-ead99905a991 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:28.184442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abcfee-cf3b-4e4d-abe3-ead99905a991 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:28.204948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:28.243080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e14cf-7d10-4d5e-88f7-fadaad85228f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:28.243697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e14cf-7d10-4d5e-88f7-fadaad85228f admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:28.243998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e14cf-7d10-4d5e-88f7-fadaad85228f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:28.244273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e14cf-7d10-4d5e-88f7-fadaad85228f admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:28.244902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e14cf-7d10-4d5e-88f7-fadaad85228f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:28.246580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e14cf-7d10-4d5e-88f7-fadaad85228f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:28.256595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1287/2591] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:32:28.260951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5650-b91a-4563-a687-c29a5c37b4fc admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:28.266924 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:28.272825 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5650-b91a-4563-a687-c29a5c37b4fc admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:28.278286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c34ef-0e9e-417b-a1d5-7e37187df6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:28.278935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c34ef-0e9e-417b-a1d5-7e37187df6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:28.279214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c34ef-0e9e-417b-a1d5-7e37187df6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:28.279489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c34ef-0e9e-417b-a1d5-7e37187df6fc admin admin] PATH_INFO: `/v3/projects/83ca0a5ff1aa44789969bf3e47a1f99d/users/159cd11fec1c4e97a580bf80f58c3205/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:28.281408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c34ef-0e9e-417b-a1d5-7e37187df6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ca0a5ff1aa44789969bf3e47a1f99d, user_id=159cd11fec1c4e97a580bf80f58c3205, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:28.284003 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c34ef-0e9e-417b-a1d5-7e37187df6fc admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:28.294288 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1305/2592] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:28 2022] PUT /identity/v3/projects/83ca0a5ff1aa44789969bf3e47a1f99d/users/159cd11fec1c4e97a580bf80f58c3205/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:28.304396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed793c-3cbf-41cd-ae29-f419f25a8007 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:28.304862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed793c-3cbf-41cd-ae29-f419f25a8007 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:28.304958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed793c-3cbf-41cd-ae29-f419f25a8007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:28.332773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c5ed793c-3cbf-41cd-ae29-f419f25a8007 None None] MFA Rules not processed for user `159cd11fec1c4e97a580bf80f58c3205`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:28.334030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c5ed793c-3cbf-41cd-ae29-f419f25a8007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:28.400429 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1288/2593] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:28.412179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c34ef-0e9e-417b-a1d5-7e37187df6fc admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:28.413907 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7b3c34ef-0e9e-417b-a1d5-7e37187df6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:28.469836 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c34ef-0e9e-417b-a1d5-7e37187df6fc admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:28.473457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7930-e3db-4684-96bd-0dd01637fdc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:28.474052 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7930-e3db-4684-96bd-0dd01637fdc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:28.474326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7930-e3db-4684-96bd-0dd01637fdc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:28.474601 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7930-e3db-4684-96bd-0dd01637fdc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:28.483326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae7930-e3db-4684-96bd-0dd01637fdc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:28.484747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae7930-e3db-4684-96bd-0dd01637fdc1 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:28.494247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1306/2594] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:28.538235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed793c-3cbf-41cd-ae29-f419f25a8007 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:28.539630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c5ed793c-3cbf-41cd-ae29-f419f25a8007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:28.551475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed793c-3cbf-41cd-ae29-f419f25a8007 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:28.555120 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f83e35-0416-4424-897e-de9747d0f50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:28.555720 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83e35-0416-4424-897e-de9747d0f50a service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:28.556000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83e35-0416-4424-897e-de9747d0f50a service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:28.556276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f83e35-0416-4424-897e-de9747d0f50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:28.612290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f83e35-0416-4424-897e-de9747d0f50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:28.613750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f83e35-0416-4424-897e-de9747d0f50a service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:28.623269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1289/2595] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:31.923731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7930-e3db-4684-96bd-0dd01637fdc1 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:31.984322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7930-e3db-4684-96bd-0dd01637fdc1 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:31.988803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:31.989459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:31.989738 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:31.990007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] PATH_INFO: `/v3/users/90fc68ff8b2848d9870473507f62fa18` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:31.991368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90fc68ff8b2848d9870473507f62fa18)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:31.993282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:32.036447 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90fc68ff8b2848d9870473507f62fa18'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.044139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90fc68ff8b2848d9870473507f62fa18'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.044741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90fc68ff8b2848d9870473507f62fa18'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.056449 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90fc68ff8b2848d9870473507f62fa18'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.063955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90fc68ff8b2848d9870473507f62fa18'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.069745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1307/2596] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:31 2022] DELETE /identity/v3/users/90fc68ff8b2848d9870473507f62fa18 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:32.074256 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38807ed9-8aa3-4836-87a9-731a703404f0 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:32.074794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38807ed9-8aa3-4836-87a9-731a703404f0 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:32.074925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38807ed9-8aa3-4836-87a9-731a703404f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:32.094082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-38807ed9-8aa3-4836-87a9-731a703404f0 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:32.094708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-38807ed9-8aa3-4836-87a9-731a703404f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:32.134289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:32.153920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1290/2597] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:32.163464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:32.164883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:32.178991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:32.224794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86381492-ac90-47e2-b077-fd1d01f2c19c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:32.228434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93323ee-9552-4f11-9351-31beed564f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:32.229039 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93323ee-9552-4f11-9351-31beed564f39 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:32.229362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93323ee-9552-4f11-9351-31beed564f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:32.229636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93323ee-9552-4f11-9351-31beed564f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:32.239002 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93323ee-9552-4f11-9351-31beed564f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:32.240692 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93323ee-9552-4f11-9351-31beed564f39 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:32.249935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1308/2598] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:32.530922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38807ed9-8aa3-4836-87a9-731a703404f0 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:32.532409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-38807ed9-8aa3-4836-87a9-731a703404f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:32.546440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38807ed9-8aa3-4836-87a9-731a703404f0 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:32.551346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:32.552010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:32.552364 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:32.552648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] PATH_INFO: `/v3/projects/e11d3277dd054c8c9ceb88e103be5788` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:32.553854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11d3277dd054c8c9ceb88e103be5788)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:32.555785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:32.614820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11d3277dd054c8c9ceb88e103be5788', 'request_id': 'req-15093f98-5f06-4080-a024-814ec62e8a58'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.623588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11d3277dd054c8c9ceb88e103be5788', 'request_id': 'req-15093f98-5f06-4080-a024-814ec62e8a58'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.629828 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11d3277dd054c8c9ceb88e103be5788', 'request_id': 'req-15093f98-5f06-4080-a024-814ec62e8a58'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.642417 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] The token cache is being invalidate because project e11d3277dd054c8c9ceb88e103be5788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:32.642709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.643386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.644897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1291/2599] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:32 2022] DELETE /identity/v3/projects/e11d3277dd054c8c9ceb88e103be5788 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:32.648782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93323ee-9552-4f11-9351-31beed564f39 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:32.659006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93323ee-9552-4f11-9351-31beed564f39 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:32.717217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:32.717808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:32.718094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:32.718380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] PATH_INFO: `/v3/users/159cd11fec1c4e97a580bf80f58c3205` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:32.719495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=159cd11fec1c4e97a580bf80f58c3205)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:32.721489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:32.770920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159cd11fec1c4e97a580bf80f58c3205'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.778628 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159cd11fec1c4e97a580bf80f58c3205'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.779364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159cd11fec1c4e97a580bf80f58c3205'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.791328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159cd11fec1c4e97a580bf80f58c3205'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.798799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bd7de3ff-70b2-4ec8-a466-8ea421e1f4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159cd11fec1c4e97a580bf80f58c3205'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:32.804592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1309/2600] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:32 2022] DELETE /identity/v3/users/159cd11fec1c4e97a580bf80f58c3205 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:32:33.078445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.079912 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:33.093934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15093f98-5f06-4080-a024-814ec62e8a58 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.151576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.152221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.152511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.153319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] PATH_INFO: `/v3/projects/83ca0a5ff1aa44789969bf3e47a1f99d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.154457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ca0a5ff1aa44789969bf3e47a1f99d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.156360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:33.208153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ca0a5ff1aa44789969bf3e47a1f99d', 'request_id': 'req-45780c15-7974-414e-aeb0-2aafb8797e17'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:33.216021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ca0a5ff1aa44789969bf3e47a1f99d', 'request_id': 'req-45780c15-7974-414e-aeb0-2aafb8797e17'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:33.221530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ca0a5ff1aa44789969bf3e47a1f99d', 'request_id': 'req-45780c15-7974-414e-aeb0-2aafb8797e17'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:33.228613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:33.234674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] The token cache is being invalidate because project 83ca0a5ff1aa44789969bf3e47a1f99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:33.235149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:33.235918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-45780c15-7974-414e-aeb0-2aafb8797e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:33.237771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1292/2601] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:33 2022] DELETE /identity/v3/projects/83ca0a5ff1aa44789969bf3e47a1f99d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:33.243132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88f60-3e79-41ac-9b4a-0f696210d412 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.243602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88f60-3e79-41ac-9b4a-0f696210d412 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.243698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc88f60-3e79-41ac-9b4a-0f696210d412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.263374 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-9fc88f60-3e79-41ac-9b4a-0f696210d412 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:33.264489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9fc88f60-3e79-41ac-9b4a-0f696210d412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:33.292975 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:33.326621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1310/2602] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:33.335610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665930-a7dd-4aed-92ce-ca17d573db57 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.335932 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665930-a7dd-4aed-92ce-ca17d573db57 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.336210 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665930-a7dd-4aed-92ce-ca17d573db57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.356295 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1c665930-a7dd-4aed-92ce-ca17d573db57 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:33.357620 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1c665930-a7dd-4aed-92ce-ca17d573db57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:33.366115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1293/2603] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:32:33.370256 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc88f60-3e79-41ac-9b4a-0f696210d412 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.380544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc88f60-3e79-41ac-9b4a-0f696210d412 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.385275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8b75-79d0-430e-a85b-c70e520b696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.385886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8b75-79d0-430e-a85b-c70e520b696b admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.386175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8b75-79d0-430e-a85b-c70e520b696b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.386450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8b75-79d0-430e-a85b-c70e520b696b admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.387103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8b75-79d0-430e-a85b-c70e520b696b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:32:33.387409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8b75-79d0-430e-a85b-c70e520b696b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.389004 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8b75-79d0-430e-a85b-c70e520b696b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:33.400711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1311/2604] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:32:33.404839 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665930-a7dd-4aed-92ce-ca17d573db57 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.415695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665930-a7dd-4aed-92ce-ca17d573db57 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.421086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e49f9-24a6-4038-9ae1-e4960b22b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.421726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e49f9-24a6-4038-9ae1-e4960b22b2cf admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.422012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e49f9-24a6-4038-9ae1-e4960b22b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.422287 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e49f9-24a6-4038-9ae1-e4960b22b2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.422927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e49f9-24a6-4038-9ae1-e4960b22b2cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.424881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e49f9-24a6-4038-9ae1-e4960b22b2cf admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:33.451963 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1294/2605] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:32:33 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:33.456171 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8b75-79d0-430e-a85b-c70e520b696b admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.467129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8b75-79d0-430e-a85b-c70e520b696b admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.522734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55744e57-980a-4d5f-b5b6-86130b1bcb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.523268 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55744e57-980a-4d5f-b5b6-86130b1bcb2b admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.523551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55744e57-980a-4d5f-b5b6-86130b1bcb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.523826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55744e57-980a-4d5f-b5b6-86130b1bcb2b admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.524461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55744e57-980a-4d5f-b5b6-86130b1bcb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.526456 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55744e57-980a-4d5f-b5b6-86130b1bcb2b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:33.548324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1312/2606] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:32:33 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:33.552376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e49f9-24a6-4038-9ae1-e4960b22b2cf admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.562836 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e49f9-24a6-4038-9ae1-e4960b22b2cf admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.567641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d98b7-1490-41c2-a13e-052bd6b179f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.568239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d98b7-1490-41c2-a13e-052bd6b179f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.568522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d98b7-1490-41c2-a13e-052bd6b179f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.568796 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d98b7-1490-41c2-a13e-052bd6b179f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.569458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d98b7-1490-41c2-a13e-052bd6b179f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.571142 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d98b7-1490-41c2-a13e-052bd6b179f5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:33.581560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1295/2607] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:33.585575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55744e57-980a-4d5f-b5b6-86130b1bcb2b admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.595984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55744e57-980a-4d5f-b5b6-86130b1bcb2b admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.600591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e669dd6-44b9-45a4-a4a1-5c3004836c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.601185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e669dd6-44b9-45a4-a4a1-5c3004836c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.601498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e669dd6-44b9-45a4-a4a1-5c3004836c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.601774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e669dd6-44b9-45a4-a4a1-5c3004836c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.602415 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e669dd6-44b9-45a4-a4a1-5c3004836c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.603998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e669dd6-44b9-45a4-a4a1-5c3004836c85 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:33.615823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1313/2608] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:33.619696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d98b7-1490-41c2-a13e-052bd6b179f5 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.629649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d98b7-1490-41c2-a13e-052bd6b179f5 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.634195 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3842c8-6149-4ed1-ab29-e739b33447b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.634838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3842c8-6149-4ed1-ab29-e739b33447b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.635117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3842c8-6149-4ed1-ab29-e739b33447b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.635392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3842c8-6149-4ed1-ab29-e739b33447b1 admin admin] PATH_INFO: `/v3/projects/407bdfc1141a401c81b64964ae97064e/users/dfb80d409d2a4a6a81c926e27ff590c3/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.651020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3842c8-6149-4ed1-ab29-e739b33447b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407bdfc1141a401c81b64964ae97064e, user_id=dfb80d409d2a4a6a81c926e27ff590c3, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.654312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3842c8-6149-4ed1-ab29-e739b33447b1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:33.670440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1296/2609] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:33 2022] PUT /identity/v3/projects/407bdfc1141a401c81b64964ae97064e/users/dfb80d409d2a4a6a81c926e27ff590c3/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:33.680539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4fbf2-7fe9-493f-933a-31a5aa3059ea None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.680822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4fbf2-7fe9-493f-933a-31a5aa3059ea None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.681089 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4fbf2-7fe9-493f-933a-31a5aa3059ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.708401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-fda4fbf2-7fe9-493f-933a-31a5aa3059ea None None] MFA Rules not processed for user `dfb80d409d2a4a6a81c926e27ff590c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:33.709639 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-fda4fbf2-7fe9-493f-933a-31a5aa3059ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:33.773706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1314/2610] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:33 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:33.778218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3842c8-6149-4ed1-ab29-e739b33447b1 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.840255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3842c8-6149-4ed1-ab29-e739b33447b1 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.844799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e652e-902a-413e-964a-640cc33238d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.845437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e652e-902a-413e-964a-640cc33238d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.845719 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e652e-902a-413e-964a-640cc33238d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.845991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e652e-902a-413e-964a-640cc33238d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.846608 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e652e-902a-413e-964a-640cc33238d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.848484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e652e-902a-413e-964a-640cc33238d5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:33.874628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1297/2611] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:32:33 2022] POST /identity/v3/projects => generated 407 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:33.878686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4fbf2-7fe9-493f-933a-31a5aa3059ea None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.889751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4fbf2-7fe9-493f-933a-31a5aa3059ea None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.914615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:33.944690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc0ad-9627-40e3-ba5f-46ed0a6b2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.945315 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc0ad-9627-40e3-ba5f-46ed0a6b2d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.945595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc0ad-9627-40e3-ba5f-46ed0a6b2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.945865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc0ad-9627-40e3-ba5f-46ed0a6b2d05 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.946490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bc0ad-9627-40e3-ba5f-46ed0a6b2d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.948434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bc0ad-9627-40e3-ba5f-46ed0a6b2d05 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:33.970426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1315/2612] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:32:33 2022] POST /identity/v3/users => generated 310 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:32:33.974418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e652e-902a-413e-964a-640cc33238d5 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:33.985069 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e652e-902a-413e-964a-640cc33238d5 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:33.989703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28400d-11b8-4a2e-9bbc-8e4d0f4a105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:33.990565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28400d-11b8-4a2e-9bbc-8e4d0f4a105e admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:33.990855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28400d-11b8-4a2e-9bbc-8e4d0f4a105e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:33.991134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28400d-11b8-4a2e-9bbc-8e4d0f4a105e admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:33.991774 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28400d-11b8-4a2e-9bbc-8e4d0f4a105e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:33.993393 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28400d-11b8-4a2e-9bbc-8e4d0f4a105e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:34.004223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1298/2613] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:34.008274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc0ad-9627-40e3-ba5f-46ed0a6b2d05 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:34.018657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bc0ad-9627-40e3-ba5f-46ed0a6b2d05 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:34.023162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836f8d-52ed-49bc-80aa-269d5935ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:34.023885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836f8d-52ed-49bc-80aa-269d5935ff8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:34.024131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836f8d-52ed-49bc-80aa-269d5935ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:34.024402 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836f8d-52ed-49bc-80aa-269d5935ff8f admin admin] PATH_INFO: `/v3/projects/bd458516c8b8413aa393948302362f39/users/a405a2348a334237879b31cd77d17c90/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:34.039217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc836f8d-52ed-49bc-80aa-269d5935ff8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd458516c8b8413aa393948302362f39, user_id=a405a2348a334237879b31cd77d17c90, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:34.041983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc836f8d-52ed-49bc-80aa-269d5935ff8f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:34.055023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1316/2614] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:34 2022] PUT /identity/v3/projects/bd458516c8b8413aa393948302362f39/users/a405a2348a334237879b31cd77d17c90/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:32:34.059483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28400d-11b8-4a2e-9bbc-8e4d0f4a105e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:34.069478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28400d-11b8-4a2e-9bbc-8e4d0f4a105e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:34.125335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721864d-c90a-42eb-b0a1-79e8fa297087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:34.125953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721864d-c90a-42eb-b0a1-79e8fa297087 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:34.126213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721864d-c90a-42eb-b0a1-79e8fa297087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:34.126484 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721864d-c90a-42eb-b0a1-79e8fa297087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:34.127115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721864d-c90a-42eb-b0a1-79e8fa297087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:34.128690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721864d-c90a-42eb-b0a1-79e8fa297087 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:34.138631 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1299/2615] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:34.142744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836f8d-52ed-49bc-80aa-269d5935ff8f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:34.153808 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836f8d-52ed-49bc-80aa-269d5935ff8f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:34.158544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d63ce-9cc5-4446-9b3e-7c6a704c8f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:34.159254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d63ce-9cc5-4446-9b3e-7c6a704c8f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:34.159493 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d63ce-9cc5-4446-9b3e-7c6a704c8f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:34.159767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d63ce-9cc5-4446-9b3e-7c6a704c8f65 admin admin] PATH_INFO: `/v3/projects/bd458516c8b8413aa393948302362f39/users/a405a2348a334237879b31cd77d17c90/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:34.161730 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d63ce-9cc5-4446-9b3e-7c6a704c8f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd458516c8b8413aa393948302362f39, user_id=a405a2348a334237879b31cd77d17c90, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:34.164399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d63ce-9cc5-4446-9b3e-7c6a704c8f65 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:34.175541 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1317/2616] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:34 2022] PUT /identity/v3/projects/bd458516c8b8413aa393948302362f39/users/a405a2348a334237879b31cd77d17c90/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:34.187801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0909657-4c29-48e6-8c98-937b1e6b9f32 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:34.188177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0909657-4c29-48e6-8c98-937b1e6b9f32 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:34.188463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0909657-4c29-48e6-8c98-937b1e6b9f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:34.197526 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:34.217333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b0909657-4c29-48e6-8c98-937b1e6b9f32 None None] MFA Rules not processed for user `a405a2348a334237879b31cd77d17c90`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:34.218541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b0909657-4c29-48e6-8c98-937b1e6b9f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:34.288470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1300/2617] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:34 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:34.298935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d63ce-9cc5-4446-9b3e-7c6a704c8f65 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:34.300703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a87d63ce-9cc5-4446-9b3e-7c6a704c8f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:34.357892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d63ce-9cc5-4446-9b3e-7c6a704c8f65 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:34.361484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f5aae-0482-466e-9f60-52e58951d05e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:34.362084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f5aae-0482-466e-9f60-52e58951d05e service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:34.362363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f5aae-0482-466e-9f60-52e58951d05e service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:34.362632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f5aae-0482-466e-9f60-52e58951d05e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:34.372198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f5aae-0482-466e-9f60-52e58951d05e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:34.373643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f5aae-0482-466e-9f60-52e58951d05e service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:34.382762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1318/2618] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:34 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:34.541497 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0909657-4c29-48e6-8c98-937b1e6b9f32 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:34.551736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0909657-4c29-48e6-8c98-937b1e6b9f32 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:34.555245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aad54-8bde-4102-a31e-8ebe162e5b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:34.556051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aad54-8bde-4102-a31e-8ebe162e5b0a service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:34.556333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aad54-8bde-4102-a31e-8ebe162e5b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:34.556602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aad54-8bde-4102-a31e-8ebe162e5b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:34.614319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aad54-8bde-4102-a31e-8ebe162e5b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:34.616176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aad54-8bde-4102-a31e-8ebe162e5b0a service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:34.625684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1301/2619] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:34 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:39.910161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f5aae-0482-466e-9f60-52e58951d05e service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:39.979320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f5aae-0482-466e-9f60-52e58951d05e service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:39.985642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:39.987903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:39.989092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:39.989431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] PATH_INFO: `/v3/users/dfb80d409d2a4a6a81c926e27ff590c3` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:39.990905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb80d409d2a4a6a81c926e27ff590c3)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:39.992949 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:40.024615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:40.046426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb80d409d2a4a6a81c926e27ff590c3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.055335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb80d409d2a4a6a81c926e27ff590c3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.056200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb80d409d2a4a6a81c926e27ff590c3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.082250 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb80d409d2a4a6a81c926e27ff590c3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.089467 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb80d409d2a4a6a81c926e27ff590c3'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.095782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1319/2620] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:39 2022] DELETE /identity/v3/users/dfb80d409d2a4a6a81c926e27ff590c3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:40.100463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988eacc-a389-484f-80f0-e41faa09f556 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:40.100855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988eacc-a389-484f-80f0-e41faa09f556 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:40.101134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988eacc-a389-484f-80f0-e41faa09f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:40.121150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-8988eacc-a389-484f-80f0-e41faa09f556 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:40.123394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8988eacc-a389-484f-80f0-e41faa09f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:40.190782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1302/2621] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:40.200525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:40.201980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:40.260354 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27e90d-e82e-4474-a4e1-22165f091b0c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:40.264682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64bf17-58b5-408f-99ed-befa7388c801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:40.265314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64bf17-58b5-408f-99ed-befa7388c801 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:40.265593 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64bf17-58b5-408f-99ed-befa7388c801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:40.265915 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64bf17-58b5-408f-99ed-befa7388c801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:40.274845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64bf17-58b5-408f-99ed-befa7388c801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:40.276260 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64bf17-58b5-408f-99ed-befa7388c801 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:40.286812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1320/2622] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:40.560106 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988eacc-a389-484f-80f0-e41faa09f556 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:40.561619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8988eacc-a389-484f-80f0-e41faa09f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:40.573844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988eacc-a389-484f-80f0-e41faa09f556 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:40.579263 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:40.579916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:40.580199 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:40.580478 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] PATH_INFO: `/v3/projects/407bdfc1141a401c81b64964ae97064e` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:40.581674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=407bdfc1141a401c81b64964ae97064e)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:40.583592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:40.608818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:40.632241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407bdfc1141a401c81b64964ae97064e', 'request_id': 'req-2312abb0-99c6-49a5-99dd-67a394587bea'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.639470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407bdfc1141a401c81b64964ae97064e', 'request_id': 'req-2312abb0-99c6-49a5-99dd-67a394587bea'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.645150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407bdfc1141a401c81b64964ae97064e', 'request_id': 'req-2312abb0-99c6-49a5-99dd-67a394587bea'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.656610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] The token cache is being invalidate because project 407bdfc1141a401c81b64964ae97064e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:40.656904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.657657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.659354 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1303/2623] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:40 2022] DELETE /identity/v3/projects/407bdfc1141a401c81b64964ae97064e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:40.663150 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64bf17-58b5-408f-99ed-befa7388c801 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:40.673139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64bf17-58b5-408f-99ed-befa7388c801 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:40.730495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:40.731151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:40.731437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:40.731709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] PATH_INFO: `/v3/users/a405a2348a334237879b31cd77d17c90` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:40.732815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a405a2348a334237879b31cd77d17c90)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:40.734737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:40.782340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a405a2348a334237879b31cd77d17c90'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.783920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:40.790612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a405a2348a334237879b31cd77d17c90'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.791685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a405a2348a334237879b31cd77d17c90'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.804522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a405a2348a334237879b31cd77d17c90'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.811857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a37a3e5d-ece6-4859-9475-3acc08ee0e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a405a2348a334237879b31cd77d17c90'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:40.817678 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1321/2624] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:40 2022] DELETE /identity/v3/users/a405a2348a334237879b31cd77d17c90 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:41.096530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:41.098005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:41.113300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312abb0-99c6-49a5-99dd-67a394587bea admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:41.174331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:41.175063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.175158 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.175437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] PATH_INFO: `/v3/projects/bd458516c8b8413aa393948302362f39` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.176573 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd458516c8b8413aa393948302362f39)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:41.178500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:41.225401 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd458516c8b8413aa393948302362f39', 'request_id': 'req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:41.233009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd458516c8b8413aa393948302362f39', 'request_id': 'req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:41.238592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd458516c8b8413aa393948302362f39', 'request_id': 'req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:41.250088 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] The token cache is being invalidate because project bd458516c8b8413aa393948302362f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:41.250383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:41.251018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-1f443979-ae17-4e2f-ae08-49f3f5fe6e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:41.252488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1304/2625] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:41 2022] DELETE /identity/v3/projects/bd458516c8b8413aa393948302362f39 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:41.257426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f100-410c-43e1-84d2-f191b4942a82 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.257887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f100-410c-43e1-84d2-f191b4942a82 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.257988 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f100-410c-43e1-84d2-f191b4942a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.279108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-bd77f100-410c-43e1-84d2-f191b4942a82 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:41.280408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-bd77f100-410c-43e1-84d2-f191b4942a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:41.344072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1322/2626] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:41.351906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0f46-3a69-4f51-9332-32e7d00e9f1e None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.352198 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0f46-3a69-4f51-9332-32e7d00e9f1e None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.352513 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0f46-3a69-4f51-9332-32e7d00e9f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.374511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-9a5c0f46-3a69-4f51-9332-32e7d00e9f1e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:41.375738 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9a5c0f46-3a69-4f51-9332-32e7d00e9f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:41.384894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1305/2627] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:41.388873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f100-410c-43e1-84d2-f191b4942a82 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:41.399416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f100-410c-43e1-84d2-f191b4942a82 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:41.404530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48526f7-93a1-4b4a-9027-d22cdf9beb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:41.405882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48526f7-93a1-4b4a-9027-d22cdf9beb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.406403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48526f7-93a1-4b4a-9027-d22cdf9beb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.407009 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48526f7-93a1-4b4a-9027-d22cdf9beb8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.407642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48526f7-93a1-4b4a-9027-d22cdf9beb8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:32:41.408023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48526f7-93a1-4b4a-9027-d22cdf9beb8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:41.410016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48526f7-93a1-4b4a-9027-d22cdf9beb8e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:41.423698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1323/2628] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:32:41.428937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c0f46-3a69-4f51-9332-32e7d00e9f1e None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:41.438559 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c0f46-3a69-4f51-9332-32e7d00e9f1e None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:41.444026 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8631a-e560-49f1-b8e0-4106b2f27bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:41.444633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8631a-e560-49f1-b8e0-4106b2f27bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.445041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8631a-e560-49f1-b8e0-4106b2f27bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.445330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8631a-e560-49f1-b8e0-4106b2f27bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.445844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8631a-e560-49f1-b8e0-4106b2f27bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:41.447767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8631a-e560-49f1-b8e0-4106b2f27bbf admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:41.476141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1306/2629] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:32:41 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:41.480294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48526f7-93a1-4b4a-9027-d22cdf9beb8e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:41.491085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48526f7-93a1-4b4a-9027-d22cdf9beb8e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:41.548777 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb51bf5-f21b-4ce1-8547-502a03b0059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:41.549428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb51bf5-f21b-4ce1-8547-502a03b0059c admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.549708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb51bf5-f21b-4ce1-8547-502a03b0059c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.549980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb51bf5-f21b-4ce1-8547-502a03b0059c admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.550640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb51bf5-f21b-4ce1-8547-502a03b0059c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:41.552583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb51bf5-f21b-4ce1-8547-502a03b0059c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:41.572653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1324/2630] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:32:41 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:41.577410 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8631a-e560-49f1-b8e0-4106b2f27bbf admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:41.587436 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8631a-e560-49f1-b8e0-4106b2f27bbf admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:41.592740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fad0e1-7a80-463e-911f-13342b5bfd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:41.593368 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fad0e1-7a80-463e-911f-13342b5bfd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.593649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fad0e1-7a80-463e-911f-13342b5bfd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.593917 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fad0e1-7a80-463e-911f-13342b5bfd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.594549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fad0e1-7a80-463e-911f-13342b5bfd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:41.596127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fad0e1-7a80-463e-911f-13342b5bfd51 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:41.605772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1307/2631] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:41.609543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb51bf5-f21b-4ce1-8547-502a03b0059c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:41.619617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb51bf5-f21b-4ce1-8547-502a03b0059c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:41.624096 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e298-4c6f-4e8f-b886-2580c63f654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:41.624685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e298-4c6f-4e8f-b886-2580c63f654d admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.624964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e298-4c6f-4e8f-b886-2580c63f654d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.625254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e298-4c6f-4e8f-b886-2580c63f654d admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.625902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1e298-4c6f-4e8f-b886-2580c63f654d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:41.627464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1e298-4c6f-4e8f-b886-2580c63f654d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:41.638320 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1325/2632] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:41.642154 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fad0e1-7a80-463e-911f-13342b5bfd51 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:41.647155 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:41.653901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fad0e1-7a80-463e-911f-13342b5bfd51 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:41.659701 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec7f46-983f-49d8-aa0b-27f48be9025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:41.660376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7f46-983f-49d8-aa0b-27f48be9025e admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.660665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7f46-983f-49d8-aa0b-27f48be9025e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.660947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7f46-983f-49d8-aa0b-27f48be9025e admin admin] PATH_INFO: `/v3/projects/2aa8fe70fcd540e88025133bde190313/users/a10e0863346b4593983f69eb1c19aa2b/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.676496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec7f46-983f-49d8-aa0b-27f48be9025e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa8fe70fcd540e88025133bde190313, user_id=a10e0863346b4593983f69eb1c19aa2b, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:41.679186 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec7f46-983f-49d8-aa0b-27f48be9025e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:41.692271 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1308/2633] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:41 2022] PUT /identity/v3/projects/2aa8fe70fcd540e88025133bde190313/users/a10e0863346b4593983f69eb1c19aa2b/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:32:41.703274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939491-306d-4da3-be9d-182667df5637 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.703567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939491-306d-4da3-be9d-182667df5637 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.703848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939491-306d-4da3-be9d-182667df5637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.732776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-90939491-306d-4da3-be9d-182667df5637 None None] MFA Rules not processed for user `a10e0863346b4593983f69eb1c19aa2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:41.734046 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-90939491-306d-4da3-be9d-182667df5637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:41.766273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:41.815238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1326/2634] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:41.826539 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec7f46-983f-49d8-aa0b-27f48be9025e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:41.828180 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bfec7f46-983f-49d8-aa0b-27f48be9025e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:41.885103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec7f46-983f-49d8-aa0b-27f48be9025e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:41.888792 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6dd30-7615-419a-ab53-56d8489f725a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:41.889431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6dd30-7615-419a-ab53-56d8489f725a service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:41.889722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6dd30-7615-419a-ab53-56d8489f725a service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:41.889995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6dd30-7615-419a-ab53-56d8489f725a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:41.898144 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6dd30-7615-419a-ab53-56d8489f725a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:41.899568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6dd30-7615-419a-ab53-56d8489f725a service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:41.908217 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1309/2635] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:41.930372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939491-306d-4da3-be9d-182667df5637 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:41.992995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939491-306d-4da3-be9d-182667df5637 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:41.998623 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:42.000509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:42.000804 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:42.001085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] PATH_INFO: `/v3/users/a10e0863346b4593983f69eb1c19aa2b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:42.003337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10e0863346b4593983f69eb1c19aa2b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:42.005340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:42.050316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10e0863346b4593983f69eb1c19aa2b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.061056 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10e0863346b4593983f69eb1c19aa2b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.061744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10e0863346b4593983f69eb1c19aa2b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.074933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10e0863346b4593983f69eb1c19aa2b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.081863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10e0863346b4593983f69eb1c19aa2b'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.087694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1327/2636] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:32:41 2022] DELETE /identity/v3/users/a10e0863346b4593983f69eb1c19aa2b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:42.092653 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a1f0d-9b41-451d-b9c7-9d55d38ce221 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:42.093034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a1f0d-9b41-451d-b9c7-9d55d38ce221 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:42.093366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a1f0d-9b41-451d-b9c7-9d55d38ce221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:42.112704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b27a1f0d-9b41-451d-b9c7-9d55d38ce221 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:42.113934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b27a1f0d-9b41-451d-b9c7-9d55d38ce221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:42.171413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1310/2637] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:42.180967 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:42.182892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:42.229115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:42.250490 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6de350-7088-42c3-b74b-95f67ccb1c2f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:42.254209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8f08f-585d-49f0-9bf7-eec935cbe1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:42.254831 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f08f-585d-49f0-9bf7-eec935cbe1ea service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:42.255116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f08f-585d-49f0-9bf7-eec935cbe1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:42.255395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f08f-585d-49f0-9bf7-eec935cbe1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:42.265546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8f08f-585d-49f0-9bf7-eec935cbe1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:42.266976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8f08f-585d-49f0-9bf7-eec935cbe1ea service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:42.276888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1328/2638] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:42.555111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a1f0d-9b41-451d-b9c7-9d55d38ce221 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:42.556658 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b27a1f0d-9b41-451d-b9c7-9d55d38ce221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:42.571489 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a1f0d-9b41-451d-b9c7-9d55d38ce221 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:42.576500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:42.577191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:42.577522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:42.577797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] PATH_INFO: `/v3/projects/2aa8fe70fcd540e88025133bde190313` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:42.578941 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa8fe70fcd540e88025133bde190313)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:42.580855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:42.631182 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa8fe70fcd540e88025133bde190313', 'request_id': 'req-37d5d4a9-478c-416f-9e81-e51e4ea53062'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.638982 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa8fe70fcd540e88025133bde190313', 'request_id': 'req-37d5d4a9-478c-416f-9e81-e51e4ea53062'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.645275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa8fe70fcd540e88025133bde190313', 'request_id': 'req-37d5d4a9-478c-416f-9e81-e51e4ea53062'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.659920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] The token cache is being invalidate because project 2aa8fe70fcd540e88025133bde190313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:32:42.660223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.661048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-37d5d4a9-478c-416f-9e81-e51e4ea53062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:32:42.663004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1311/2639] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:32:42 2022] DELETE /identity/v3/projects/2aa8fe70fcd540e88025133bde190313 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:42.667523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f947f-b0ae-485a-8225-dd9ecf9970a5 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:42.667906 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f947f-b0ae-485a-8225-dd9ecf9970a5 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:42.668815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f947f-b0ae-485a-8225-dd9ecf9970a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:42.692646 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-715f947f-b0ae-485a-8225-dd9ecf9970a5 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:42.694570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-715f947f-b0ae-485a-8225-dd9ecf9970a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:42.756667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1329/2640] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:32:42.820278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36109e-600e-4cf8-a6ea-6d599300bc12 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:42.820566 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36109e-600e-4cf8-a6ea-6d599300bc12 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:42.820845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36109e-600e-4cf8-a6ea-6d599300bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:42.830496 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:42.842422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6f36109e-600e-4cf8-a6ea-6d599300bc12 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:42.843634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6f36109e-600e-4cf8-a6ea-6d599300bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:42.851609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1312/2641] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:42.855833 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f947f-b0ae-485a-8225-dd9ecf9970a5 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:42.865580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f947f-b0ae-485a-8225-dd9ecf9970a5 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:42.870545 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b67d8c-9a43-42ca-bd01-8ef890d3fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:42.871140 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67d8c-9a43-42ca-bd01-8ef890d3fbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:42.871961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67d8c-9a43-42ca-bd01-8ef890d3fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:42.872239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67d8c-9a43-42ca-bd01-8ef890d3fbb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:42.872888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b67d8c-9a43-42ca-bd01-8ef890d3fbb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:32:42.873196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b67d8c-9a43-42ca-bd01-8ef890d3fbb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:42.874860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b67d8c-9a43-42ca-bd01-8ef890d3fbb7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:42.886473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1330/2642] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:32:42.891360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36109e-600e-4cf8-a6ea-6d599300bc12 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:42.900661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36109e-600e-4cf8-a6ea-6d599300bc12 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:42.905517 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efc580-0fa8-4131-bb0a-4e53725b3dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:42.906168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc580-0fa8-4131-bb0a-4e53725b3dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:42.906470 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc580-0fa8-4131-bb0a-4e53725b3dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:42.906750 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc580-0fa8-4131-bb0a-4e53725b3dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:42.907422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efc580-0fa8-4131-bb0a-4e53725b3dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:42.909410 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efc580-0fa8-4131-bb0a-4e53725b3dc8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:42.936428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1313/2643] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:32:42 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:42.940631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b67d8c-9a43-42ca-bd01-8ef890d3fbb7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:42.951347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b67d8c-9a43-42ca-bd01-8ef890d3fbb7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:43.007477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b2bac-79e8-4f68-90fd-56627e7929a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:43.008087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b2bac-79e8-4f68-90fd-56627e7929a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:43.008373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b2bac-79e8-4f68-90fd-56627e7929a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:43.008652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b2bac-79e8-4f68-90fd-56627e7929a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:43.009348 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b2bac-79e8-4f68-90fd-56627e7929a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:43.011253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b2bac-79e8-4f68-90fd-56627e7929a7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:43.033162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1331/2644] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:32:42 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:32:43.037359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efc580-0fa8-4131-bb0a-4e53725b3dc8 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:43.047459 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efc580-0fa8-4131-bb0a-4e53725b3dc8 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:43.052016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842c5a-5a11-4352-a8dd-4b76d98fd65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:43.052615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842c5a-5a11-4352-a8dd-4b76d98fd65f admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:43.052898 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842c5a-5a11-4352-a8dd-4b76d98fd65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:43.053175 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842c5a-5a11-4352-a8dd-4b76d98fd65f admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:43.053842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e842c5a-5a11-4352-a8dd-4b76d98fd65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:43.055424 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e842c5a-5a11-4352-a8dd-4b76d98fd65f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:43.065704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1314/2645] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:43.069521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b2bac-79e8-4f68-90fd-56627e7929a7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:43.080768 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b2bac-79e8-4f68-90fd-56627e7929a7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:43.086941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be838cf6-8dbd-4e8d-911c-301d410cea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:43.088063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838cf6-8dbd-4e8d-911c-301d410cea11 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:43.088632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838cf6-8dbd-4e8d-911c-301d410cea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:43.088935 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838cf6-8dbd-4e8d-911c-301d410cea11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:43.089631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be838cf6-8dbd-4e8d-911c-301d410cea11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:43.091701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be838cf6-8dbd-4e8d-911c-301d410cea11 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:43.104714 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1332/2646] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:32:43.109502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842c5a-5a11-4352-a8dd-4b76d98fd65f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:43.119695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842c5a-5a11-4352-a8dd-4b76d98fd65f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:43.124935 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e73bb-4fbc-4d90-a25f-ecaacaf428fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:43.125612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e73bb-4fbc-4d90-a25f-ecaacaf428fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:43.125893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e73bb-4fbc-4d90-a25f-ecaacaf428fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:43.126167 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e73bb-4fbc-4d90-a25f-ecaacaf428fb admin admin] PATH_INFO: `/v3/projects/85b0b069fbf34be5838ecb64b0d473b6/users/c04e27b6e0924660b94c2992434f50a8/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:43.141842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e73bb-4fbc-4d90-a25f-ecaacaf428fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b0b069fbf34be5838ecb64b0d473b6, user_id=c04e27b6e0924660b94c2992434f50a8, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:43.144463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e73bb-4fbc-4d90-a25f-ecaacaf428fb admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:43.157413 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1315/2647] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:32:43 2022] PUT /identity/v3/projects/85b0b069fbf34be5838ecb64b0d473b6/users/c04e27b6e0924660b94c2992434f50a8/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:32:43.167156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce87cb8-48f3-4e69-82d2-5e24c5e59864 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:43.167439 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce87cb8-48f3-4e69-82d2-5e24c5e59864 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:43.167713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce87cb8-48f3-4e69-82d2-5e24c5e59864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:43.194961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8ce87cb8-48f3-4e69-82d2-5e24c5e59864 None None] MFA Rules not processed for user `c04e27b6e0924660b94c2992434f50a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:43.196146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8ce87cb8-48f3-4e69-82d2-5e24c5e59864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:43.234554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:32:43.261296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1333/2648] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:32:43.272842 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e73bb-4fbc-4d90-a25f-ecaacaf428fb admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:32:43.274552 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-291e73bb-4fbc-4d90-a25f-ecaacaf428fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:43.330893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e73bb-4fbc-4d90-a25f-ecaacaf428fb admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:32:43.334576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff7959-d416-4b21-819f-7ae172615072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:32:43.335184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7959-d416-4b21-819f-7ae172615072 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:43.335465 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7959-d416-4b21-819f-7ae172615072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:43.335742 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7959-d416-4b21-819f-7ae172615072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:43.344506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff7959-d416-4b21-819f-7ae172615072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:32:43.345969 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff7959-d416-4b21-819f-7ae172615072 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:32:43.354656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1316/2649] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:32:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:32:50.608976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349ec9-3a55-4f41-aa0a-511f60468aba None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:32:50.609470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349ec9-3a55-4f41-aa0a-511f60468aba None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:32:50.609652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349ec9-3a55-4f41-aa0a-511f60468aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:32:50.629547 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-f2349ec9-3a55-4f41-aa0a-511f60468aba None None] MFA Rules not processed for user `c334003dcc634b4c86ba14c542fb60aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:32:50.630792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f2349ec9-3a55-4f41-aa0a-511f60468aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:32:50.686766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1334/2650] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:32:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:32:53.350626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:33:00.679373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=35 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:33:06.320083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc81ee6-c689-444d-951f-9d723ba3dafe None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:06.320570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc81ee6-c689-444d-951f-9d723ba3dafe None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:06.320674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc81ee6-c689-444d-951f-9d723ba3dafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:06.340239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6dc81ee6-c689-444d-951f-9d723ba3dafe None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:33:06.341471 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6dc81ee6-c689-444d-951f-9d723ba3dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:33:06.402832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1317/2651] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:33:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:33:06.451641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349ec9-3a55-4f41-aa0a-511f60468aba None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:33:06.453155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f2349ec9-3a55-4f41-aa0a-511f60468aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:33:06.523862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349ec9-3a55-4f41-aa0a-511f60468aba None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:33:06.528922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb5712-f5cb-4fe3-b07e-cee8afec7f01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:33:06.529572 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb5712-f5cb-4fe3-b07e-cee8afec7f01 service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:06.529860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb5712-f5cb-4fe3-b07e-cee8afec7f01 service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:06.530138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb5712-f5cb-4fe3-b07e-cee8afec7f01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:06.538120 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb5712-f5cb-4fe3-b07e-cee8afec7f01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:33:06.539694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb5712-f5cb-4fe3-b07e-cee8afec7f01 service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:33:06.548100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1335/2652] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:33:16.396010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=25 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:33:16.544523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=32 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:33:18.858086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc81ee6-c689-444d-951f-9d723ba3dafe None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:33:18.920468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc81ee6-c689-444d-951f-9d723ba3dafe None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:33:18.925079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:33:18.925679 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:18.925964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:18.926269 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] PATH_INFO: `/v3/users/c04e27b6e0924660b94c2992434f50a8` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:18.927420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04e27b6e0924660b94c2992434f50a8)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:33:18.929382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:33:18.975281 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04e27b6e0924660b94c2992434f50a8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:18.982813 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04e27b6e0924660b94c2992434f50a8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:18.983426 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04e27b6e0924660b94c2992434f50a8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:18.995435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04e27b6e0924660b94c2992434f50a8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:19.002797 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04e27b6e0924660b94c2992434f50a8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:19.008530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1318/2653] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:33:18 2022] DELETE /identity/v3/users/c04e27b6e0924660b94c2992434f50a8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:33:19.013061 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b09af3-5c7e-42ea-a1f7-c86803ed20db None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:19.013571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b09af3-5c7e-42ea-a1f7-c86803ed20db None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:19.013672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b09af3-5c7e-42ea-a1f7-c86803ed20db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:19.032324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a6b09af3-5c7e-42ea-a1f7-c86803ed20db None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:33:19.033541 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a6b09af3-5c7e-42ea-a1f7-c86803ed20db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:33:19.090783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1336/2654] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:33:19.101029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:33:19.102528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:33:19.161063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171279c-0c05-40e3-b038-b800f2af18ce admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:33:19.164721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea94c42-5201-43f1-97b6-29db1f97aae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:33:19.165367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea94c42-5201-43f1-97b6-29db1f97aae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:19.165654 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea94c42-5201-43f1-97b6-29db1f97aae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:19.165929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea94c42-5201-43f1-97b6-29db1f97aae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:19.175549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea94c42-5201-43f1-97b6-29db1f97aae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:33:19.176925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea94c42-5201-43f1-97b6-29db1f97aae0 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:33:19.186687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1319/2655] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:33:19.457730 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b09af3-5c7e-42ea-a1f7-c86803ed20db None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:33:19.459347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a6b09af3-5c7e-42ea-a1f7-c86803ed20db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:33:19.472193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b09af3-5c7e-42ea-a1f7-c86803ed20db None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:33:19.477323 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:33:19.477979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:19.478263 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:19.478671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] PATH_INFO: `/v3/projects/85b0b069fbf34be5838ecb64b0d473b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:19.480007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b0b069fbf34be5838ecb64b0d473b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:33:19.481970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:33:19.530773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b0b069fbf34be5838ecb64b0d473b6', 'request_id': 'req-48deb5cf-a4df-4947-af6b-cf800595fcfb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:19.537275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b0b069fbf34be5838ecb64b0d473b6', 'request_id': 'req-48deb5cf-a4df-4947-af6b-cf800595fcfb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:19.543153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b0b069fbf34be5838ecb64b0d473b6', 'request_id': 'req-48deb5cf-a4df-4947-af6b-cf800595fcfb'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:19.556286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] The token cache is being invalidate because project 85b0b069fbf34be5838ecb64b0d473b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:33:19.556582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:19.557224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:33:19.558824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1337/2656] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:33:19 2022] DELETE /identity/v3/projects/85b0b069fbf34be5838ecb64b0d473b6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:33:25.122839 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232aec-1e2b-4ac2-9e31-5505e93a4c38 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:25.123288 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232aec-1e2b-4ac2-9e31-5505e93a4c38 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:25.123399 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232aec-1e2b-4ac2-9e31-5505e93a4c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:25.155560 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-97232aec-1e2b-4ac2-9e31-5505e93a4c38 None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:33:25.156798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-97232aec-1e2b-4ac2-9e31-5505e93a4c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:33:25.163773 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:33:25.239040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1320/2657] 10.222.0.61 () {58 vars in 1009 bytes} [Thu Sep 22 18:33:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:33:25.251201 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:33:25.252603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:33:25.341579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:33:25.344230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deb5cf-a4df-4947-af6b-cf800595fcfb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:33:25.350962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ec941-2428-4374-a79c-7af1e5625d13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:33:25.351784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec941-2428-4374-a79c-7af1e5625d13 service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:25.352255 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec941-2428-4374-a79c-7af1e5625d13 service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:25.352539 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec941-2428-4374-a79c-7af1e5625d13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:25.361092 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ec941-2428-4374-a79c-7af1e5625d13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:33:25.362690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ec941-2428-4374-a79c-7af1e5625d13 service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:33:25.370982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1338/2658] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:33:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:33:35.237176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=31 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:33:35.367475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:33:42.856523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00d01a-b22e-4e28-9d31-48b08a9421ec None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:42.856972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00d01a-b22e-4e28-9d31-48b08a9421ec None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:42.857067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00d01a-b22e-4e28-9d31-48b08a9421ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:42.886550 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3c00d01a-b22e-4e28-9d31-48b08a9421ec None None] MFA Rules not processed for user `99c9b7ef3a7345879747a2193ad8044c`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:33:42.887761 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3c00d01a-b22e-4e28-9d31-48b08a9421ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:33:42.895501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1321/2659] 10.222.0.61 () {58 vars in 967 bytes} [Thu Sep 22 18:33:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:33:42.908146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ec941-2428-4374-a79c-7af1e5625d13 service swift] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:33:42.918817 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ec941-2428-4374-a79c-7af1e5625d13 service swift] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:33:42.923839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dbed9-ef60-4dfb-82ea-7b6633bf9f9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e20585b86c2d45da8ca53fa1db2ccd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:33:42.924436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dbed9-ef60-4dfb-82ea-7b6633bf9f9c service swift] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:33:42.924721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dbed9-ef60-4dfb-82ea-7b6633bf9f9c service swift] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:33:42.924996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dbed9-ef60-4dfb-82ea-7b6633bf9f9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:33:42.932930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dbed9-ef60-4dfb-82ea-7b6633bf9f9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:33:42.934481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dbed9-ef60-4dfb-82ea-7b6633bf9f9c service swift] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:33:42.942421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1339/2660] 10.222.0.61 () {60 vars in 1384 bytes} [Thu Sep 22 18:33:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 18:33:52.881661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=7 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:33:52.939214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=6 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:32.722630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00d01a-b22e-4e28-9d31-48b08a9421ec None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:32.724119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3c00d01a-b22e-4e28-9d31-48b08a9421ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:32.822118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00d01a-b22e-4e28-9d31-48b08a9421ec None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:32.827194 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:32.827814 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:32.828095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:32.828369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:32.830099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:32.841671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:32.843758 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:32.853700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1322/2661] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:39.034028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dbed9-ef60-4dfb-82ea-7b6633bf9f9c service swift] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:39.035527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-5b0dbed9-ef60-4dfb-82ea-7b6633bf9f9c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:39.113905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dbed9-ef60-4dfb-82ea-7b6633bf9f9c service swift] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:39.117546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5f1af-303c-40f9-8f83-0e3c0a7d8587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:39.118151 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5f1af-303c-40f9-8f83-0e3c0a7d8587 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:39.118438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5f1af-303c-40f9-8f83-0e3c0a7d8587 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:39.118716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5f1af-303c-40f9-8f83-0e3c0a7d8587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:39.120712 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-24a5f1af-303c-40f9-8f83-0e3c0a7d8587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:39.333277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5f1af-303c-40f9-8f83-0e3c0a7d8587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:39.334715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5f1af-303c-40f9-8f83-0e3c0a7d8587 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:39.354640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1340/2662] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:42.849520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=41 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:43.060908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:43.063124 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:43.082996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69592bca-73aa-4b0e-9593-8d2c7ee56df2 service placement] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:43.088979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:43.089674 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:43.089967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:43.090245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] PATH_INFO: `/v3/users/c334003dcc634b4c86ba14c542fb60aa` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:43.091400 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c334003dcc634b4c86ba14c542fb60aa)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:43.093562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:43.150443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c334003dcc634b4c86ba14c542fb60aa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.162971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c334003dcc634b4c86ba14c542fb60aa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.163762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c334003dcc634b4c86ba14c542fb60aa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.179823 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c334003dcc634b4c86ba14c542fb60aa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.187852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-cb53b1a0-e602-458e-bcce-4137f35b5d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c334003dcc634b4c86ba14c542fb60aa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.194512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1323/2663] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:34:43 2022] DELETE /identity/v3/users/c334003dcc634b4c86ba14c542fb60aa => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:43.401393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5f1af-303c-40f9-8f83-0e3c0a7d8587 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:43.412334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5f1af-303c-40f9-8f83-0e3c0a7d8587 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:43.480790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:43.481567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:43.482047 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:43.482425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] PATH_INFO: `/v3/projects/4a75a45a96f84c34b553e519a1f6005c` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:43.487878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a75a45a96f84c34b553e519a1f6005c)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:43.489883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:43.495805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:43.550940 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a75a45a96f84c34b553e519a1f6005c', 'request_id': 'req-bab5cacf-cd8b-4b34-8b41-90208430e1fd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.558751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a75a45a96f84c34b553e519a1f6005c', 'request_id': 'req-bab5cacf-cd8b-4b34-8b41-90208430e1fd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.568063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a75a45a96f84c34b553e519a1f6005c', 'request_id': 'req-bab5cacf-cd8b-4b34-8b41-90208430e1fd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.583135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] The token cache is being invalidate because project 4a75a45a96f84c34b553e519a1f6005c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:34:43.583452 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.584126 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-bab5cacf-cd8b-4b34-8b41-90208430e1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:43.585748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1341/2664] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:34:43 2022] DELETE /identity/v3/projects/4a75a45a96f84c34b553e519a1f6005c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:43.590723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd6b94-21a1-4fff-8b7c-416c97a8a996 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:43.591035 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd6b94-21a1-4fff-8b7c-416c97a8a996 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:43.591381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd6b94-21a1-4fff-8b7c-416c97a8a996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:43.667353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-09cd6b94-21a1-4fff-8b7c-416c97a8a996 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:43.669290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-09cd6b94-21a1-4fff-8b7c-416c97a8a996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:43.743906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1324/2665] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:43.752577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4259be-13e1-49dd-90aa-4a666a4acdde None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:43.752898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4259be-13e1-49dd-90aa-4a666a4acdde None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:43.753139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4259be-13e1-49dd-90aa-4a666a4acdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:43.774731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4e4259be-13e1-49dd-90aa-4a666a4acdde None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:43.775873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4e4259be-13e1-49dd-90aa-4a666a4acdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:43.792907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd6b94-21a1-4fff-8b7c-416c97a8a996 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:43.793725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1342/2666] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:43.803650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd6b94-21a1-4fff-8b7c-416c97a8a996 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:43.808272 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37830a-62bf-479f-8ff5-1a8feeb95837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:43.808885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37830a-62bf-479f-8ff5-1a8feeb95837 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:43.809169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37830a-62bf-479f-8ff5-1a8feeb95837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:43.809520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37830a-62bf-479f-8ff5-1a8feeb95837 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:43.810116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37830a-62bf-479f-8ff5-1a8feeb95837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:34:43.810422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37830a-62bf-479f-8ff5-1a8feeb95837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:43.812050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37830a-62bf-479f-8ff5-1a8feeb95837 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:43.824899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1325/2667] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:34:43.829014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4259be-13e1-49dd-90aa-4a666a4acdde None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:43.841550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4259be-13e1-49dd-90aa-4a666a4acdde None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:43.846792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37d0b-11a1-493f-b55a-ca24f1c2cd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:43.847400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37d0b-11a1-493f-b55a-ca24f1c2cd32 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:43.847680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37d0b-11a1-493f-b55a-ca24f1c2cd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:43.848016 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37d0b-11a1-493f-b55a-ca24f1c2cd32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:43.848655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a37d0b-11a1-493f-b55a-ca24f1c2cd32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:43.850580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a37d0b-11a1-493f-b55a-ca24f1c2cd32 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:43.884902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1343/2668] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:34:43 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:43.886292 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37830a-62bf-479f-8ff5-1a8feeb95837 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:43.898928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37830a-62bf-479f-8ff5-1a8feeb95837 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:43.932899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:43.974548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79761682-0713-484c-9f3d-2396c1bb2375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:43.975301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79761682-0713-484c-9f3d-2396c1bb2375 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:43.975646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79761682-0713-484c-9f3d-2396c1bb2375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:43.976342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79761682-0713-484c-9f3d-2396c1bb2375 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:43.976894 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79761682-0713-484c-9f3d-2396c1bb2375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:43.979146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79761682-0713-484c-9f3d-2396c1bb2375 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.007971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1326/2669] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:34:43 2022] POST /identity/v3/users => generated 302 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:44.012196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37d0b-11a1-493f-b55a-ca24f1c2cd32 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.023257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37d0b-11a1-493f-b55a-ca24f1c2cd32 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:44.027874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c97a2-3761-4f67-8763-3c9b25fb2093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:44.028502 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c97a2-3761-4f67-8763-3c9b25fb2093 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.028788 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c97a2-3761-4f67-8763-3c9b25fb2093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.029055 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c97a2-3761-4f67-8763-3c9b25fb2093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.029733 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c97a2-3761-4f67-8763-3c9b25fb2093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:44.031865 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c97a2-3761-4f67-8763-3c9b25fb2093 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.041899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1344/2670] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:44.045932 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79761682-0713-484c-9f3d-2396c1bb2375 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.056549 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79761682-0713-484c-9f3d-2396c1bb2375 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:44.061353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbef8d0-2636-431e-adbd-51a399470bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:44.062001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbef8d0-2636-431e-adbd-51a399470bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.062286 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbef8d0-2636-431e-adbd-51a399470bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.062563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbef8d0-2636-431e-adbd-51a399470bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.063202 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbef8d0-2636-431e-adbd-51a399470bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:44.064821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbef8d0-2636-431e-adbd-51a399470bf0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.075618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1327/2671] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:44.079611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c97a2-3761-4f67-8763-3c9b25fb2093 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.089426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c97a2-3761-4f67-8763-3c9b25fb2093 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:44.094722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9a55-0a6e-4632-9c86-93075570f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:44.095389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9a55-0a6e-4632-9c86-93075570f43c admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.095696 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9a55-0a6e-4632-9c86-93075570f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.095974 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9a55-0a6e-4632-9c86-93075570f43c admin admin] PATH_INFO: `/v3/projects/1a051e83972541cbb42c4ceace22e37c/users/c2bcfd24781f4f31899a8a6a6babc132/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.111240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab9a55-0a6e-4632-9c86-93075570f43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a051e83972541cbb42c4ceace22e37c, user_id=c2bcfd24781f4f31899a8a6a6babc132, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:44.113925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab9a55-0a6e-4632-9c86-93075570f43c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.127266 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1345/2672] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:44 2022] PUT /identity/v3/projects/1a051e83972541cbb42c4ceace22e37c/users/c2bcfd24781f4f31899a8a6a6babc132/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:34:44.137283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab026c8-69f4-4e7e-b83a-7590d85caa30 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.137506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab026c8-69f4-4e7e-b83a-7590d85caa30 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.137776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab026c8-69f4-4e7e-b83a-7590d85caa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.165759 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-3ab026c8-69f4-4e7e-b83a-7590d85caa30 None None] MFA Rules not processed for user `c2bcfd24781f4f31899a8a6a6babc132`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:44.166975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-3ab026c8-69f4-4e7e-b83a-7590d85caa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:44.237971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1328/2673] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:44.242481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9a55-0a6e-4632-9c86-93075570f43c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.310454 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9a55-0a6e-4632-9c86-93075570f43c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:44.315169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031b6d7-b125-4172-8667-93cd1ef5070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:44.315980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b6d7-b125-4172-8667-93cd1ef5070d admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.316161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b6d7-b125-4172-8667-93cd1ef5070d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.316368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031b6d7-b125-4172-8667-93cd1ef5070d admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.317155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031b6d7-b125-4172-8667-93cd1ef5070d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:44.319215 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031b6d7-b125-4172-8667-93cd1ef5070d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.350005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1346/2674] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:34:44 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:34:44.354153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab026c8-69f4-4e7e-b83a-7590d85caa30 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.366093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab026c8-69f4-4e7e-b83a-7590d85caa30 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:44.435174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fffe72-54f0-49f1-b2f0-32d311baab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:44.435799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fffe72-54f0-49f1-b2f0-32d311baab4c admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.436086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fffe72-54f0-49f1-b2f0-32d311baab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.436366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fffe72-54f0-49f1-b2f0-32d311baab4c admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.437609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fffe72-54f0-49f1-b2f0-32d311baab4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:44.439522 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fffe72-54f0-49f1-b2f0-32d311baab4c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.460457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1329/2675] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:34:44 2022] POST /identity/v3/users => generated 308 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:44.464491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031b6d7-b125-4172-8667-93cd1ef5070d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.475113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031b6d7-b125-4172-8667-93cd1ef5070d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:44.479944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5305d-3d3d-44b6-92b9-3de8f67a7c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:44.480552 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5305d-3d3d-44b6-92b9-3de8f67a7c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.480839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5305d-3d3d-44b6-92b9-3de8f67a7c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.481112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5305d-3d3d-44b6-92b9-3de8f67a7c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.481786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5305d-3d3d-44b6-92b9-3de8f67a7c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:44.483382 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5305d-3d3d-44b6-92b9-3de8f67a7c65 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.494393 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1347/2676] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:44.498652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fffe72-54f0-49f1-b2f0-32d311baab4c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.509665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fffe72-54f0-49f1-b2f0-32d311baab4c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:44.516899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd609a4-9f72-4d69-83f4-284645de6ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:44.518080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd609a4-9f72-4d69-83f4-284645de6ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.518080 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd609a4-9f72-4d69-83f4-284645de6ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.518291 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd609a4-9f72-4d69-83f4-284645de6ac9 admin admin] PATH_INFO: `/v3/projects/42720c8f865c43e1b9a430504d888d5e/users/de25cfffdab34fb1865c1af24bea5efd/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.536446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd609a4-9f72-4d69-83f4-284645de6ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42720c8f865c43e1b9a430504d888d5e, user_id=de25cfffdab34fb1865c1af24bea5efd, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:44.539394 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd609a4-9f72-4d69-83f4-284645de6ac9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.556032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1330/2677] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:44 2022] PUT /identity/v3/projects/42720c8f865c43e1b9a430504d888d5e/users/de25cfffdab34fb1865c1af24bea5efd/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:44.559989 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5305d-3d3d-44b6-92b9-3de8f67a7c65 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.566137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:44.589846 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5305d-3d3d-44b6-92b9-3de8f67a7c65 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:44.689411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8888e-2a3c-42e9-9a8d-4788bbf5ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:44.690113 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8888e-2a3c-42e9-9a8d-4788bbf5ab26 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.690677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8888e-2a3c-42e9-9a8d-4788bbf5ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.691028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8888e-2a3c-42e9-9a8d-4788bbf5ab26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.691749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8888e-2a3c-42e9-9a8d-4788bbf5ab26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:44.693634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8888e-2a3c-42e9-9a8d-4788bbf5ab26 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.708289 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1348/2678] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:44.712541 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd609a4-9f72-4d69-83f4-284645de6ac9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.719177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:44.725606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd609a4-9f72-4d69-83f4-284645de6ac9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:44.732254 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd662a-315c-42da-9a3f-b7a849443ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:44.734805 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd662a-315c-42da-9a3f-b7a849443ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.735845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd662a-315c-42da-9a3f-b7a849443ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.736253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd662a-315c-42da-9a3f-b7a849443ed0 admin admin] PATH_INFO: `/v3/projects/42720c8f865c43e1b9a430504d888d5e/users/de25cfffdab34fb1865c1af24bea5efd/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.739939 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd662a-315c-42da-9a3f-b7a849443ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42720c8f865c43e1b9a430504d888d5e, user_id=de25cfffdab34fb1865c1af24bea5efd, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:44.748163 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd662a-315c-42da-9a3f-b7a849443ed0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:44.770688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1331/2679] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:44 2022] PUT /identity/v3/projects/42720c8f865c43e1b9a430504d888d5e/users/de25cfffdab34fb1865c1af24bea5efd/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:44.783811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2abd-3016-4a4b-b408-85bdceb5ab38 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:44.784098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2abd-3016-4a4b-b408-85bdceb5ab38 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:44.784428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2abd-3016-4a4b-b408-85bdceb5ab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:44.823153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-087e2abd-3016-4a4b-b408-85bdceb5ab38 None None] MFA Rules not processed for user `de25cfffdab34fb1865c1af24bea5efd`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:44.824472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-087e2abd-3016-4a4b-b408-85bdceb5ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:44.956109 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1349/2680] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:44 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:44.966712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd662a-315c-42da-9a3f-b7a849443ed0 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:44.969146 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d0dd662a-315c-42da-9a3f-b7a849443ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:45.053597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd662a-315c-42da-9a3f-b7a849443ed0 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:45.057441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3824f-cc08-4ae5-b93f-50ef17dc3f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:45.058051 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3824f-cc08-4ae5-b93f-50ef17dc3f3a service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:45.058323 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3824f-cc08-4ae5-b93f-50ef17dc3f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:45.058605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3824f-cc08-4ae5-b93f-50ef17dc3f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:45.068469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3824f-cc08-4ae5-b93f-50ef17dc3f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:45.070049 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3824f-cc08-4ae5-b93f-50ef17dc3f3a service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:45.080557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1332/2681] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:44 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:45.237939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e2abd-3016-4a4b-b408-85bdceb5ab38 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:45.312929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e2abd-3016-4a4b-b408-85bdceb5ab38 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:45.317770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:45.318443 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:45.318702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:45.318970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] PATH_INFO: `/v3/users/c2bcfd24781f4f31899a8a6a6babc132` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:45.320127 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2bcfd24781f4f31899a8a6a6babc132)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:45.322058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:45.352640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:45.371910 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2bcfd24781f4f31899a8a6a6babc132'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:45.379303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2bcfd24781f4f31899a8a6a6babc132'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:45.380025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2bcfd24781f4f31899a8a6a6babc132'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:45.392993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2bcfd24781f4f31899a8a6a6babc132'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:45.399885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2bcfd24781f4f31899a8a6a6babc132'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:45.405848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1350/2682] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:34:45 2022] DELETE /identity/v3/users/c2bcfd24781f4f31899a8a6a6babc132 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:45.410583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1ef9-a67b-4c39-b9c1-9ebf638f9737 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:45.410874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1ef9-a67b-4c39-b9c1-9ebf638f9737 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:45.411153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1ef9-a67b-4c39-b9c1-9ebf638f9737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:45.430331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-980e1ef9-a67b-4c39-b9c1-9ebf638f9737 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:45.431525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-980e1ef9-a67b-4c39-b9c1-9ebf638f9737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:45.488544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1333/2683] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:45.498358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:45.500300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:45.560240 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee034b-a711-4d9a-9b85-6c019e9bb7fe admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:45.564471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7abdb-f995-4c9d-bdc8-b9342fe087e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:45.565082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7abdb-f995-4c9d-bdc8-b9342fe087e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:45.565405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7abdb-f995-4c9d-bdc8-b9342fe087e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:45.565682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7abdb-f995-4c9d-bdc8-b9342fe087e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:45.574895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7abdb-f995-4c9d-bdc8-b9342fe087e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:45.576321 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7abdb-f995-4c9d-bdc8-b9342fe087e9 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:45.586771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1351/2684] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:45.959636 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e1ef9-a67b-4c39-b9c1-9ebf638f9737 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:45.962718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-980e1ef9-a67b-4c39-b9c1-9ebf638f9737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:45.981473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e1ef9-a67b-4c39-b9c1-9ebf638f9737 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:45.987027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:45.987695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:45.988516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:45.988516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] PATH_INFO: `/v3/projects/1a051e83972541cbb42c4ceace22e37c` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:45.989468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a051e83972541cbb42c4ceace22e37c)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:45.992097 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:46.041855 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a051e83972541cbb42c4ceace22e37c', 'request_id': 'req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.051016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a051e83972541cbb42c4ceace22e37c', 'request_id': 'req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.057061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a051e83972541cbb42c4ceace22e37c', 'request_id': 'req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.059889 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:46.072336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] The token cache is being invalidate because project 1a051e83972541cbb42c4ceace22e37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:34:46.072609 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.073321 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-890a5f24-c1ec-46e0-85aa-fc0e4e355b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.075299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1334/2685] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:34:45 2022] DELETE /identity/v3/projects/1a051e83972541cbb42c4ceace22e37c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:46.079187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7abdb-f995-4c9d-bdc8-b9342fe087e9 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:46.088725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7abdb-f995-4c9d-bdc8-b9342fe087e9 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:46.144982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:46.145654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.145939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.146216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] PATH_INFO: `/v3/users/de25cfffdab34fb1865c1af24bea5efd` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.147344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=de25cfffdab34fb1865c1af24bea5efd)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:46.149285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:46.206065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de25cfffdab34fb1865c1af24bea5efd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.208854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:46.218686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de25cfffdab34fb1865c1af24bea5efd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.219571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de25cfffdab34fb1865c1af24bea5efd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.237230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de25cfffdab34fb1865c1af24bea5efd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.244604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-6d1d5fe4-48fd-4450-922b-3c8740e2bcdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de25cfffdab34fb1865c1af24bea5efd'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.254718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1352/2686] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:34:46 2022] DELETE /identity/v3/users/de25cfffdab34fb1865c1af24bea5efd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:46.370232 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e11eb7-62da-4bcc-a98f-8be8b813ce18 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.371183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e11eb7-62da-4bcc-a98f-8be8b813ce18 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.371901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e11eb7-62da-4bcc-a98f-8be8b813ce18 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.374103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1335/2687] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:34:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 18:34:46.379774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8def3-bbe8-4b1e-bccf-a988e82dfec1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.380083 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8def3-bbe8-4b1e-bccf-a988e82dfec1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.380358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8def3-bbe8-4b1e-bccf-a988e82dfec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.409464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-d4e8def3-bbe8-4b1e-bccf-a988e82dfec1 None None] MFA Rules not processed for user `8d0b8fc336694043a34f007b78c45c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:46.410708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d4e8def3-bbe8-4b1e-bccf-a988e82dfec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:46.474816 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1353/2688] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:34:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:46.488053 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e11eb7-62da-4bcc-a98f-8be8b813ce18 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:46.490588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-25e11eb7-62da-4bcc-a98f-8be8b813ce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:46.504991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e11eb7-62da-4bcc-a98f-8be8b813ce18 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:46.510213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89ef51-61d9-49b6-9060-78cb37d5b36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:46.511050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89ef51-61d9-49b6-9060-78cb37d5b36f service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.511486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89ef51-61d9-49b6-9060-78cb37d5b36f service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.512014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89ef51-61d9-49b6-9060-78cb37d5b36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.520643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89ef51-61d9-49b6-9060-78cb37d5b36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:46.522408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89ef51-61d9-49b6-9060-78cb37d5b36f service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:46.532000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1336/2689] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:46.635025 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8def3-bbe8-4b1e-bccf-a988e82dfec1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:46.636347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d4e8def3-bbe8-4b1e-bccf-a988e82dfec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:46.659090 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eec4d-0c90-4535-8760-ea88ffc91546 None None] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.659367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eec4d-0c90-4535-8760-ea88ffc91546 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.659643 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eec4d-0c90-4535-8760-ea88ffc91546 None None] PATH_INFO: `/` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.660987 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1337/2690] 10.222.0.61 () {54 vars in 921 bytes} [Thu Sep 22 18:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 18:34:46.668010 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e770b6b-7bec-42e8-af24-30d835a4fc6f None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.668457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e770b6b-7bec-42e8-af24-30d835a4fc6f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.669529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e770b6b-7bec-42e8-af24-30d835a4fc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.710121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-8e770b6b-7bec-42e8-af24-30d835a4fc6f None None] MFA Rules not processed for user `d710bb85a200419aa071e119976115c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:46.711340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8e770b6b-7bec-42e8-af24-30d835a4fc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:46.731783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8def3-bbe8-4b1e-bccf-a988e82dfec1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:46.737630 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:46.738328 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.738615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.738892 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] PATH_INFO: `/v3/projects/42720c8f865c43e1b9a430504d888d5e` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.740235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42720c8f865c43e1b9a430504d888d5e)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:46.742248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:46.801596 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42720c8f865c43e1b9a430504d888d5e', 'request_id': 'req-a7b56051-12a6-4685-9c2f-583ae0da3c21'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.809174 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42720c8f865c43e1b9a430504d888d5e', 'request_id': 'req-a7b56051-12a6-4685-9c2f-583ae0da3c21'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.815139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1338/2691] 10.222.0.61 () {58 vars in 1018 bytes} [Thu Sep 22 18:34:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:46.816300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42720c8f865c43e1b9a430504d888d5e', 'request_id': 'req-a7b56051-12a6-4685-9c2f-583ae0da3c21'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.829058 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e770b6b-7bec-42e8-af24-30d835a4fc6f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:46.830687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8e770b6b-7bec-42e8-af24-30d835a4fc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:46.831281 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] The token cache is being invalidate because project 42720c8f865c43e1b9a430504d888d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:34:46.831568 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.832238 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a7b56051-12a6-4685-9c2f-583ae0da3c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:46.833735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1354/2692] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:34:46 2022] DELETE /identity/v3/projects/42720c8f865c43e1b9a430504d888d5e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:46.838324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164396e8-7365-425b-9342-c7cf6249a27e None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.838721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164396e8-7365-425b-9342-c7cf6249a27e None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.839077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164396e8-7365-425b-9342-c7cf6249a27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.843031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e770b6b-7bec-42e8-af24-30d835a4fc6f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:46.848450 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:46.864893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-164396e8-7365-425b-9342-c7cf6249a27e None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:46.866567 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-164396e8-7365-425b-9342-c7cf6249a27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:46.935327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1355/2693] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:46.943900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5caf8c-6ced-48ee-9b41-6d8c35ec5366 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.944191 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5caf8c-6ced-48ee-9b41-6d8c35ec5366 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.944473 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5caf8c-6ced-48ee-9b41-6d8c35ec5366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.966609 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-1a5caf8c-6ced-48ee-9b41-6d8c35ec5366 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:46.967855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-1a5caf8c-6ced-48ee-9b41-6d8c35ec5366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:46.976038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1356/2694] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:46.980313 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5caf8c-6ced-48ee-9b41-6d8c35ec5366 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:46.990314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5caf8c-6ced-48ee-9b41-6d8c35ec5366 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:46.995070 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95753335-b94c-48f2-a618-8a6a77936ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:46.995944 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95753335-b94c-48f2-a618-8a6a77936ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:46.996224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95753335-b94c-48f2-a618-8a6a77936ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:46.996498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95753335-b94c-48f2-a618-8a6a77936ecb admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:46.997154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95753335-b94c-48f2-a618-8a6a77936ecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:34:46.997537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95753335-b94c-48f2-a618-8a6a77936ecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:46.999138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95753335-b94c-48f2-a618-8a6a77936ecb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.016958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1357/2695] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:34:47.017984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95753335-b94c-48f2-a618-8a6a77936ecb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.027515 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6089457-5d35-4d95-9ddb-fe0735f1c899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.028141 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6089457-5d35-4d95-9ddb-fe0735f1c899 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.028423 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6089457-5d35-4d95-9ddb-fe0735f1c899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.028698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6089457-5d35-4d95-9ddb-fe0735f1c899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.030500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a6089457-5d35-4d95-9ddb-fe0735f1c899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:47.030781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95753335-b94c-48f2-a618-8a6a77936ecb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.036347 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18393fee-2531-4ec5-8344-76df457247eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.037214 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18393fee-2531-4ec5-8344-76df457247eb admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.037521 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18393fee-2531-4ec5-8344-76df457247eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.037792 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18393fee-2531-4ec5-8344-76df457247eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.038414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18393fee-2531-4ec5-8344-76df457247eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.040938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18393fee-2531-4ec5-8344-76df457247eb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.077488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1358/2696] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:34:47 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:47.078895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18393fee-2531-4ec5-8344-76df457247eb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.113825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:47.116607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6089457-5d35-4d95-9ddb-fe0735f1c899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.118803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6089457-5d35-4d95-9ddb-fe0735f1c899 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.134762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1339/2697] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:34:47.161724 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18393fee-2531-4ec5-8344-76df457247eb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.167203 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbeb48-48f4-4859-af61-9ce734a0a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.167845 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbeb48-48f4-4859-af61-9ce734a0a433 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.168133 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbeb48-48f4-4859-af61-9ce734a0a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.168407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbeb48-48f4-4859-af61-9ce734a0a433 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.169051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbeb48-48f4-4859-af61-9ce734a0a433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.171035 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbeb48-48f4-4859-af61-9ce734a0a433 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.195767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1359/2698] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:34:47 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:34:47.199646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6089457-5d35-4d95-9ddb-fe0735f1c899 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.211300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6089457-5d35-4d95-9ddb-fe0735f1c899 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.216056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b9c3-6867-4d08-974c-82a206ae8c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.216704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b9c3-6867-4d08-974c-82a206ae8c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.216984 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b9c3-6867-4d08-974c-82a206ae8c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.217290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b9c3-6867-4d08-974c-82a206ae8c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.217922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13b9c3-6867-4d08-974c-82a206ae8c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.220117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13b9c3-6867-4d08-974c-82a206ae8c9f admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.230483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1340/2699] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:47.234549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbeb48-48f4-4859-af61-9ce734a0a433 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.244577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbeb48-48f4-4859-af61-9ce734a0a433 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.249606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9be76-e799-4d2f-b879-1b5090a1f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.250230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9be76-e799-4d2f-b879-1b5090a1f74e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.250513 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9be76-e799-4d2f-b879-1b5090a1f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.250787 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9be76-e799-4d2f-b879-1b5090a1f74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.251555 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9be76-e799-4d2f-b879-1b5090a1f74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.253090 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9be76-e799-4d2f-b879-1b5090a1f74e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.262976 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1360/2700] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:34:47.267867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b9c3-6867-4d08-974c-82a206ae8c9f admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.278017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b9c3-6867-4d08-974c-82a206ae8c9f admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.283320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d527c-7dc4-42f5-b8da-4f73c662f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.284021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d527c-7dc4-42f5-b8da-4f73c662f8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.284310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d527c-7dc4-42f5-b8da-4f73c662f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.284589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d527c-7dc4-42f5-b8da-4f73c662f8dd admin admin] PATH_INFO: `/v3/projects/6e46c2760a7f4af0a99a00dab2fbecf3/users/3adcdf949dd6463b95ca2abbc4b81be2/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.302453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d527c-7dc4-42f5-b8da-4f73c662f8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e46c2760a7f4af0a99a00dab2fbecf3, user_id=3adcdf949dd6463b95ca2abbc4b81be2, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.305082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d527c-7dc4-42f5-b8da-4f73c662f8dd admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.322187 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1341/2701] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:47 2022] PUT /identity/v3/projects/6e46c2760a7f4af0a99a00dab2fbecf3/users/3adcdf949dd6463b95ca2abbc4b81be2/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:34:47.332999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425144c4-572e-4257-a179-8a5d7b0f0022 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.333395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425144c4-572e-4257-a179-8a5d7b0f0022 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.333746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425144c4-572e-4257-a179-8a5d7b0f0022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.362022 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-425144c4-572e-4257-a179-8a5d7b0f0022 None None] MFA Rules not processed for user `3adcdf949dd6463b95ca2abbc4b81be2`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:47.363222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-425144c4-572e-4257-a179-8a5d7b0f0022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:47.398727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:47.437185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1361/2702] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:47.441804 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d527c-7dc4-42f5-b8da-4f73c662f8dd admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.509420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d527c-7dc4-42f5-b8da-4f73c662f8dd admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.514467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d2f0-7732-4d7c-bc86-c4deac0dd9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.515594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d2f0-7732-4d7c-bc86-c4deac0dd9ce admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.515872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d2f0-7732-4d7c-bc86-c4deac0dd9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.516140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d2f0-7732-4d7c-bc86-c4deac0dd9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.516790 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400d2f0-7732-4d7c-bc86-c4deac0dd9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.518683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400d2f0-7732-4d7c-bc86-c4deac0dd9ce admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.546881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1342/2703] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:34:47 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:34:47.550893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425144c4-572e-4257-a179-8a5d7b0f0022 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.563050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425144c4-572e-4257-a179-8a5d7b0f0022 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.624903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da2744-a6ba-4543-83a2-9a1aae65c95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.625634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da2744-a6ba-4543-83a2-9a1aae65c95b admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.625979 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da2744-a6ba-4543-83a2-9a1aae65c95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.626312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da2744-a6ba-4543-83a2-9a1aae65c95b admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.627012 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da2744-a6ba-4543-83a2-9a1aae65c95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.629205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da2744-a6ba-4543-83a2-9a1aae65c95b admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.658483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1362/2704] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:34:47 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:47.660162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d2f0-7732-4d7c-bc86-c4deac0dd9ce admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.674039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d2f0-7732-4d7c-bc86-c4deac0dd9ce admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.677475 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e975e-2b6d-4333-8fd4-decea957047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.678104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e975e-2b6d-4333-8fd4-decea957047b admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.678411 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e975e-2b6d-4333-8fd4-decea957047b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.678688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e975e-2b6d-4333-8fd4-decea957047b admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.679342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e975e-2b6d-4333-8fd4-decea957047b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.680927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e975e-2b6d-4333-8fd4-decea957047b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.692760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1343/2705] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:34:47.696643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da2744-a6ba-4543-83a2-9a1aae65c95b admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.707727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da2744-a6ba-4543-83a2-9a1aae65c95b admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.713821 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecbbaa-f152-4654-b341-3b657ae67859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.714503 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbbaa-f152-4654-b341-3b657ae67859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.714933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbbaa-f152-4654-b341-3b657ae67859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.715351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbbaa-f152-4654-b341-3b657ae67859 admin admin] PATH_INFO: `/v3/projects/7ccf2955cef448a3aa6f43ca995e55cd/users/08838049c3904dc0989753a55f6a24a5/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.734882 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecbbaa-f152-4654-b341-3b657ae67859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ccf2955cef448a3aa6f43ca995e55cd, user_id=08838049c3904dc0989753a55f6a24a5, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.738750 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecbbaa-f152-4654-b341-3b657ae67859 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.759563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1363/2706] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:47 2022] PUT /identity/v3/projects/7ccf2955cef448a3aa6f43ca995e55cd/users/08838049c3904dc0989753a55f6a24a5/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:47.765763 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e975e-2b6d-4333-8fd4-decea957047b admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.776569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e975e-2b6d-4333-8fd4-decea957047b admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.847060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a154952-e1a8-4f88-a83b-4f6eea5041b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.847642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154952-e1a8-4f88-a83b-4f6eea5041b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.847927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154952-e1a8-4f88-a83b-4f6eea5041b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.848206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154952-e1a8-4f88-a83b-4f6eea5041b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.849027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a154952-e1a8-4f88-a83b-4f6eea5041b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.850822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a154952-e1a8-4f88-a83b-4f6eea5041b0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.863593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1344/2707] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:47.867597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecbbaa-f152-4654-b341-3b657ae67859 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:47.879731 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecbbaa-f152-4654-b341-3b657ae67859 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:47.884564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557cca2-4f1f-4943-afbf-767ce08f4dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:47.885420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557cca2-4f1f-4943-afbf-767ce08f4dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.885725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557cca2-4f1f-4943-afbf-767ce08f4dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.885984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557cca2-4f1f-4943-afbf-767ce08f4dd1 admin admin] PATH_INFO: `/v3/projects/7ccf2955cef448a3aa6f43ca995e55cd/users/08838049c3904dc0989753a55f6a24a5/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.887922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557cca2-4f1f-4943-afbf-767ce08f4dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ccf2955cef448a3aa6f43ca995e55cd, user_id=08838049c3904dc0989753a55f6a24a5, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:47.891377 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557cca2-4f1f-4943-afbf-767ce08f4dd1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:47.903610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1364/2708] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:47 2022] PUT /identity/v3/projects/7ccf2955cef448a3aa6f43ca995e55cd/users/08838049c3904dc0989753a55f6a24a5/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:47.915480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b284-631f-4315-a1f1-5c9c83c79cc3 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:47.915768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b284-631f-4315-a1f1-5c9c83c79cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:47.916113 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b284-631f-4315-a1f1-5c9c83c79cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:47.950820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-7fa8b284-631f-4315-a1f1-5c9c83c79cc3 None None] MFA Rules not processed for user `08838049c3904dc0989753a55f6a24a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:47.952044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7fa8b284-631f-4315-a1f1-5c9c83c79cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:47.973099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:48.028980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1345/2709] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:48.040841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557cca2-4f1f-4943-afbf-767ce08f4dd1 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:48.042585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-d557cca2-4f1f-4943-afbf-767ce08f4dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:48.112057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557cca2-4f1f-4943-afbf-767ce08f4dd1 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:48.116406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff2be-96c9-4aac-a0cc-c9e8c91791ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:48.117094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff2be-96c9-4aac-a0cc-c9e8c91791ad service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:48.117457 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff2be-96c9-4aac-a0cc-c9e8c91791ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:48.117774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff2be-96c9-4aac-a0cc-c9e8c91791ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:48.128856 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ff2be-96c9-4aac-a0cc-c9e8c91791ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:48.130594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ff2be-96c9-4aac-a0cc-c9e8c91791ad service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:48.140864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1365/2710] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:48.220579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8b284-631f-4315-a1f1-5c9c83c79cc3 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:48.230650 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8b284-631f-4315-a1f1-5c9c83c79cc3 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:48.235721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc3d29-0b13-4911-ba7f-059857771963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:48.235721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc3d29-0b13-4911-ba7f-059857771963 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:48.235721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc3d29-0b13-4911-ba7f-059857771963 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:48.235721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc3d29-0b13-4911-ba7f-059857771963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:48.295350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc3d29-0b13-4911-ba7f-059857771963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:48.297021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc3d29-0b13-4911-ba7f-059857771963 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:48.306733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1346/2711] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:49.047600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff2be-96c9-4aac-a0cc-c9e8c91791ad service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:49.049031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b96ff2be-96c9-4aac-a0cc-c9e8c91791ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:49.080123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:49.107550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff2be-96c9-4aac-a0cc-c9e8c91791ad service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:49.111121 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858efe8-15ab-410a-bec0-433dc88aace3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:49.111726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858efe8-15ab-410a-bec0-433dc88aace3 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:49.112029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858efe8-15ab-410a-bec0-433dc88aace3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:49.112302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858efe8-15ab-410a-bec0-433dc88aace3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:49.114027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7858efe8-15ab-410a-bec0-433dc88aace3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:49.179050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858efe8-15ab-410a-bec0-433dc88aace3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:49.180491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858efe8-15ab-410a-bec0-433dc88aace3 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:49.190824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1366/2712] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:51.045407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc3d29-0b13-4911-ba7f-059857771963 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:51.057061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc3d29-0b13-4911-ba7f-059857771963 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:51.061736 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:51.063102 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:51.063390 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:51.063659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] PATH_INFO: `/v3/users/3adcdf949dd6463b95ca2abbc4b81be2` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:51.064800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adcdf949dd6463b95ca2abbc4b81be2)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:51.066731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:51.121101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adcdf949dd6463b95ca2abbc4b81be2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.130825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adcdf949dd6463b95ca2abbc4b81be2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.131595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adcdf949dd6463b95ca2abbc4b81be2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.145183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adcdf949dd6463b95ca2abbc4b81be2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.158784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adcdf949dd6463b95ca2abbc4b81be2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.165468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1347/2713] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:34:51 2022] DELETE /identity/v3/users/3adcdf949dd6463b95ca2abbc4b81be2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:34:51.170008 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6948da-88f6-49f3-930c-8e8d7a231f31 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:51.170458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6948da-88f6-49f3-930c-8e8d7a231f31 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:51.170576 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6948da-88f6-49f3-930c-8e8d7a231f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:51.190707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ab6948da-88f6-49f3-930c-8e8d7a231f31 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:51.192002 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ab6948da-88f6-49f3-930c-8e8d7a231f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:51.254252 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1367/2714] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:51.264253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:51.265948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:51.303495 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:51.334568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5997e5b-1f8d-42c4-9bb7-574e6453d6c7 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:51.338226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc22d9-eb09-4a63-b0d0-a0d6f71210cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:51.338909 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc22d9-eb09-4a63-b0d0-a0d6f71210cc service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:51.339259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc22d9-eb09-4a63-b0d0-a0d6f71210cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:51.339602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc22d9-eb09-4a63-b0d0-a0d6f71210cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:51.349528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc22d9-eb09-4a63-b0d0-a0d6f71210cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:51.351048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc22d9-eb09-4a63-b0d0-a0d6f71210cc service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:51.361995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1348/2715] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:51.664337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6948da-88f6-49f3-930c-8e8d7a231f31 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:51.664337 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ab6948da-88f6-49f3-930c-8e8d7a231f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:51.685517 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6948da-88f6-49f3-930c-8e8d7a231f31 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:51.690930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:51.691773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:51.692123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:51.692519 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] PATH_INFO: `/v3/projects/6e46c2760a7f4af0a99a00dab2fbecf3` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:51.694023 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e46c2760a7f4af0a99a00dab2fbecf3)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:51.696216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:51.746358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e46c2760a7f4af0a99a00dab2fbecf3', 'request_id': 'req-79c65b5c-a45a-444f-8f72-28fee509fd86'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.754689 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e46c2760a7f4af0a99a00dab2fbecf3', 'request_id': 'req-79c65b5c-a45a-444f-8f72-28fee509fd86'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.761672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e46c2760a7f4af0a99a00dab2fbecf3', 'request_id': 'req-79c65b5c-a45a-444f-8f72-28fee509fd86'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.771482 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:51.775790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] The token cache is being invalidate because project 6e46c2760a7f4af0a99a00dab2fbecf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:34:51.776426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.777291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.779695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1368/2716] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:34:51 2022] DELETE /identity/v3/projects/6e46c2760a7f4af0a99a00dab2fbecf3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:51.784348 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc22d9-eb09-4a63-b0d0-a0d6f71210cc service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:51.795259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc22d9-eb09-4a63-b0d0-a0d6f71210cc service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:51.854931 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:51.855531 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:51.855816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:51.856093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] PATH_INFO: `/v3/users/08838049c3904dc0989753a55f6a24a5` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:51.857206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=08838049c3904dc0989753a55f6a24a5)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:51.859212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:51.916099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08838049c3904dc0989753a55f6a24a5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.924993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08838049c3904dc0989753a55f6a24a5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.925881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08838049c3904dc0989753a55f6a24a5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.939408 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08838049c3904dc0989753a55f6a24a5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.946616 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d178f7c1-839b-4072-b059-1b5ce2198dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08838049c3904dc0989753a55f6a24a5'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:51.957287 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1349/2717] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:34:51 2022] DELETE /identity/v3/users/08838049c3904dc0989753a55f6a24a5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:52.479477 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:52.481111 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:52.496965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65b5c-a45a-444f-8f72-28fee509fd86 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:52.571108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:52.571834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:52.572154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:52.572426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] PATH_INFO: `/v3/projects/7ccf2955cef448a3aa6f43ca995e55cd` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:52.573541 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ccf2955cef448a3aa6f43ca995e55cd)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:52.575472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:52.638795 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ccf2955cef448a3aa6f43ca995e55cd', 'request_id': 'req-85161e93-e6ab-4789-9b51-557464a86418'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.647573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ccf2955cef448a3aa6f43ca995e55cd', 'request_id': 'req-85161e93-e6ab-4789-9b51-557464a86418'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.654247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ccf2955cef448a3aa6f43ca995e55cd', 'request_id': 'req-85161e93-e6ab-4789-9b51-557464a86418'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.690305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] The token cache is being invalidate because project 7ccf2955cef448a3aa6f43ca995e55cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:34:52.690939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.691691 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.693280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1369/2718] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:34:52 2022] DELETE /identity/v3/projects/7ccf2955cef448a3aa6f43ca995e55cd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:52.698045 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c6e4a-11b5-40d5-aea8-9f2d76da7566 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:52.698571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c6e4a-11b5-40d5-aea8-9f2d76da7566 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:52.698671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c6e4a-11b5-40d5-aea8-9f2d76da7566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:52.719359 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-cc9c6e4a-11b5-40d5-aea8-9f2d76da7566 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:52.720589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-cc9c6e4a-11b5-40d5-aea8-9f2d76da7566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:52.776713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:52.777721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:52.779807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:52.798447 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1350/2719] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:52.806137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501381-693b-4219-a59d-76b14185ef48 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:52.806737 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501381-693b-4219-a59d-76b14185ef48 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:52.807030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501381-693b-4219-a59d-76b14185ef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:52.827439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c4501381-693b-4219-a59d-76b14185ef48 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:52.829205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c4501381-693b-4219-a59d-76b14185ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:52.837270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1351/2720] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:52.841695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501381-693b-4219-a59d-76b14185ef48 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:52.850562 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501381-693b-4219-a59d-76b14185ef48 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:52.854350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85161e93-e6ab-4789-9b51-557464a86418 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:52.855192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23baa1-0efe-4409-a70c-07611f37e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:52.855781 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23baa1-0efe-4409-a70c-07611f37e16c admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:52.856061 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23baa1-0efe-4409-a70c-07611f37e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:52.856336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23baa1-0efe-4409-a70c-07611f37e16c admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:52.856975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23baa1-0efe-4409-a70c-07611f37e16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:34:52.857301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23baa1-0efe-4409-a70c-07611f37e16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:52.858925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23baa1-0efe-4409-a70c-07611f37e16c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:52.859596 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:52.860708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:52.861189 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:52.861745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] PATH_INFO: `/v3/users/626b85e5875b4d47b410f4f43aca0497` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:52.863322 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] RBAC: Authorizing `identity:delete_user(user_id=626b85e5875b4d47b410f4f43aca0497)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:52.866298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:52.871157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1352/2721] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 18:34:52.875877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23baa1-0efe-4409-a70c-07611f37e16c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:52.885695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23baa1-0efe-4409-a70c-07611f37e16c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:52.890283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09589ac4-e64b-444c-92b6-04c00d63d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:52.890870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589ac4-e64b-444c-92b6-04c00d63d7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:52.891283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589ac4-e64b-444c-92b6-04c00d63d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:52.891575 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589ac4-e64b-444c-92b6-04c00d63d7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:52.892329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09589ac4-e64b-444c-92b6-04c00d63d7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:52.894768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09589ac4-e64b-444c-92b6-04c00d63d7d5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:52.903942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:52.920537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626b85e5875b4d47b410f4f43aca0497'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.923166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1353/2722] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:34:52 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:52.927231 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09589ac4-e64b-444c-92b6-04c00d63d7d5 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:52.931958 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626b85e5875b4d47b410f4f43aca0497'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.932756 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626b85e5875b4d47b410f4f43aca0497'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.947340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626b85e5875b4d47b410f4f43aca0497'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.956495 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626b85e5875b4d47b410f4f43aca0497'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:52.963938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1370/2723] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:34:52 2022] DELETE /identity/v3/users/626b85e5875b4d47b410f4f43aca0497 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:34:53.002349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09589ac4-e64b-444c-92b6-04c00d63d7d5 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.078188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425a761-4414-4dc1-9763-37ff63f27be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.079031 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425a761-4414-4dc1-9763-37ff63f27be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.079758 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425a761-4414-4dc1-9763-37ff63f27be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.080044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425a761-4414-4dc1-9763-37ff63f27be6 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.080684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425a761-4414-4dc1-9763-37ff63f27be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.082664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425a761-4414-4dc1-9763-37ff63f27be6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.111768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1354/2724] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:34:52 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:53.113531 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.115897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:53.130498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384e727-8af9-4036-83e2-728ace14303a admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.135581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865acdef-f937-41b6-9ba9-8c9ab6112db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.136262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865acdef-f937-41b6-9ba9-8c9ab6112db8 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.136468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865acdef-f937-41b6-9ba9-8c9ab6112db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.136741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865acdef-f937-41b6-9ba9-8c9ab6112db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.137424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865acdef-f937-41b6-9ba9-8c9ab6112db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.139021 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865acdef-f937-41b6-9ba9-8c9ab6112db8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.150744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1371/2725] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:53.154844 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425a761-4414-4dc1-9763-37ff63f27be6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.160996 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865acdef-f937-41b6-9ba9-8c9ab6112db8 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.163292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-865acdef-f937-41b6-9ba9-8c9ab6112db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:53.175060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425a761-4414-4dc1-9763-37ff63f27be6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.177962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865acdef-f937-41b6-9ba9-8c9ab6112db8 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.181415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15be68-629e-4a5d-98ad-24bdba360cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.182381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15be68-629e-4a5d-98ad-24bdba360cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.182664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15be68-629e-4a5d-98ad-24bdba360cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.183306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15be68-629e-4a5d-98ad-24bdba360cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.183426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.183624 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15be68-629e-4a5d-98ad-24bdba360cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.183749 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.184138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.184418 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] PATH_INFO: `/v3/projects/2d3f502ab01f49dd909d482c8e6aa39d` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.185387 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15be68-629e-4a5d-98ad-24bdba360cc6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.185577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3f502ab01f49dd909d482c8e6aa39d)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.188053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.201637 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1355/2726] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:34:53.205838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15be68-629e-4a5d-98ad-24bdba360cc6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.217949 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15be68-629e-4a5d-98ad-24bdba360cc6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.223310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cede097-0fd7-4f6e-9ebc-84a53ed2c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.224009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede097-0fd7-4f6e-9ebc-84a53ed2c01c admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.224293 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede097-0fd7-4f6e-9ebc-84a53ed2c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.224571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede097-0fd7-4f6e-9ebc-84a53ed2c01c admin admin] PATH_INFO: `/v3/projects/75b6b02a14fc47d297f9a5ab880d8a4f/users/cd2f43805d9d4bb186fda22203d5dde8/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.241938 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3f502ab01f49dd909d482c8e6aa39d', 'request_id': 'req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:53.242119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cede097-0fd7-4f6e-9ebc-84a53ed2c01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b6b02a14fc47d297f9a5ab880d8a4f, user_id=cd2f43805d9d4bb186fda22203d5dde8, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.244644 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cede097-0fd7-4f6e-9ebc-84a53ed2c01c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.249961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3f502ab01f49dd909d482c8e6aa39d', 'request_id': 'req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:53.256344 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3f502ab01f49dd909d482c8e6aa39d', 'request_id': 'req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:53.258854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1356/2727] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:53 2022] PUT /identity/v3/projects/75b6b02a14fc47d297f9a5ab880d8a4f/users/cd2f43805d9d4bb186fda22203d5dde8/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:53.269062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9acd21-b351-4140-86de-d0428e0be1f1 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.269469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9acd21-b351-4140-86de-d0428e0be1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.270028 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9acd21-b351-4140-86de-d0428e0be1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.275684 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] The token cache is being invalidate because project 2d3f502ab01f49dd909d482c8e6aa39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:34:53.275973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:53.276611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e5e53d2a-d5e4-451b-ae06-c1589422a3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:53.278141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1372/2728] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:34:53 2022] DELETE /identity/v3/projects/2d3f502ab01f49dd909d482c8e6aa39d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:53.283695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d3af7-aef0-4217-8d4c-ce539c84947c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.283977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d3af7-aef0-4217-8d4c-ce539c84947c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.284248 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d3af7-aef0-4217-8d4c-ce539c84947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.289961 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:53.301978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-cb9acd21-b351-4140-86de-d0428e0be1f1 None None] MFA Rules not processed for user `cd2f43805d9d4bb186fda22203d5dde8`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:53.303213 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-cb9acd21-b351-4140-86de-d0428e0be1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:53.304852 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a95d3af7-aef0-4217-8d4c-ce539c84947c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:53.306057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a95d3af7-aef0-4217-8d4c-ce539c84947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:53.364380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1373/2729] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:53.370388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1357/2730] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:53.372512 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb1e63-6e6d-43f8-895f-ee0a193d03ef None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.372805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb1e63-6e6d-43f8-895f-ee0a193d03ef None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.373087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb1e63-6e6d-43f8-895f-ee0a193d03ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.375706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9acd21-b351-4140-86de-d0428e0be1f1 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.377058 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-cb9acd21-b351-4140-86de-d0428e0be1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:53.390135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9acd21-b351-4140-86de-d0428e0be1f1 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.392781 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-34bb1e63-6e6d-43f8-895f-ee0a193d03ef None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:53.394037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-34bb1e63-6e6d-43f8-895f-ee0a193d03ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:53.394745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c658-bea4-4ee8-afbb-528ca1540f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.395373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c658-bea4-4ee8-afbb-528ca1540f52 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.395652 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c658-bea4-4ee8-afbb-528ca1540f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.395928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c658-bea4-4ee8-afbb-528ca1540f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.396558 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294c658-bea4-4ee8-afbb-528ca1540f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.398490 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294c658-bea4-4ee8-afbb-528ca1540f52 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.401923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1374/2731] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:53.406123 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb1e63-6e6d-43f8-895f-ee0a193d03ef None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.415147 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb1e63-6e6d-43f8-895f-ee0a193d03ef None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.420267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3466-bf7d-4f8b-bdbc-6078231ef845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.420875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3466-bf7d-4f8b-bdbc-6078231ef845 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.421657 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3466-bf7d-4f8b-bdbc-6078231ef845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.421945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3466-bf7d-4f8b-bdbc-6078231ef845 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.422613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3466-bf7d-4f8b-bdbc-6078231ef845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:34:53.422921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3466-bf7d-4f8b-bdbc-6078231ef845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.424511 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3466-bf7d-4f8b-bdbc-6078231ef845 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.427876 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1358/2732] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:34:53 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:53.431793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c658-bea4-4ee8-afbb-528ca1540f52 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.437887 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1375/2733] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:34:53.441718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3466-bf7d-4f8b-bdbc-6078231ef845 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.446648 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:53.452551 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3466-bf7d-4f8b-bdbc-6078231ef845 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.494725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c658-bea4-4ee8-afbb-528ca1540f52 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.500249 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9f2f3-52a0-4eb3-a3e8-9728b349a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.500861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9f2f3-52a0-4eb3-a3e8-9728b349a734 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.501151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9f2f3-52a0-4eb3-a3e8-9728b349a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.501460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9f2f3-52a0-4eb3-a3e8-9728b349a734 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.502086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9f2f3-52a0-4eb3-a3e8-9728b349a734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.503974 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9f2f3-52a0-4eb3-a3e8-9728b349a734 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.510380 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d98d5-7a4c-4dd9-bd6a-f3a2891ee850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.511038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d98d5-7a4c-4dd9-bd6a-f3a2891ee850 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.511305 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d98d5-7a4c-4dd9-bd6a-f3a2891ee850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.511582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d98d5-7a4c-4dd9-bd6a-f3a2891ee850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.512224 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d98d5-7a4c-4dd9-bd6a-f3a2891ee850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.514134 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d98d5-7a4c-4dd9-bd6a-f3a2891ee850 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.525431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1359/2734] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:34:53 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:53.529246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9f2f3-52a0-4eb3-a3e8-9728b349a734 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.540107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9f2f3-52a0-4eb3-a3e8-9728b349a734 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.548834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1376/2735] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:34:53 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:53.549004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558e903-8512-4c44-b5a8-5b91a3f44fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.549004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558e903-8512-4c44-b5a8-5b91a3f44fef admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.549004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558e903-8512-4c44-b5a8-5b91a3f44fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.549004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558e903-8512-4c44-b5a8-5b91a3f44fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.549409 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558e903-8512-4c44-b5a8-5b91a3f44fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.550330 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558e903-8512-4c44-b5a8-5b91a3f44fef admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.550643 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d98d5-7a4c-4dd9-bd6a-f3a2891ee850 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.562265 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1360/2736] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:34:53.566227 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558e903-8512-4c44-b5a8-5b91a3f44fef admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.576026 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558e903-8512-4c44-b5a8-5b91a3f44fef admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.632432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d98d5-7a4c-4dd9-bd6a-f3a2891ee850 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.633075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:53.638862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67dc5-cbfc-45f9-b467-5882b4bd449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.640104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67dc5-cbfc-45f9-b467-5882b4bd449c admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.641081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67dc5-cbfc-45f9-b467-5882b4bd449c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.641339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d34df8-49ae-4d6d-85d3-6f771a7f4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.641615 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67dc5-cbfc-45f9-b467-5882b4bd449c admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.641964 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d34df8-49ae-4d6d-85d3-6f771a7f4c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.642209 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc67dc5-cbfc-45f9-b467-5882b4bd449c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.642718 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d34df8-49ae-4d6d-85d3-6f771a7f4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.643391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d34df8-49ae-4d6d-85d3-6f771a7f4c4e admin admin] PATH_INFO: `/v3/projects/15c3d0261f9247858db50d06d24f8a20/users/221d48680b4d4c2dbe0a6fd841c44f01/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.644404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc67dc5-cbfc-45f9-b467-5882b4bd449c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.662551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d34df8-49ae-4d6d-85d3-6f771a7f4c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c3d0261f9247858db50d06d24f8a20, user_id=221d48680b4d4c2dbe0a6fd841c44f01, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.665607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d34df8-49ae-4d6d-85d3-6f771a7f4c4e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.673901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1377/2737] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:34:53 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:34:53.677343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67dc5-cbfc-45f9-b467-5882b4bd449c admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.685672 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1361/2738] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:53 2022] PUT /identity/v3/projects/15c3d0261f9247858db50d06d24f8a20/users/221d48680b4d4c2dbe0a6fd841c44f01/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:53.689715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d34df8-49ae-4d6d-85d3-6f771a7f4c4e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.690672 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67dc5-cbfc-45f9-b467-5882b4bd449c admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.759630 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaee8c-5716-499c-90dd-7b1f72d55606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.760308 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaee8c-5716-499c-90dd-7b1f72d55606 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.760592 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaee8c-5716-499c-90dd-7b1f72d55606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.760869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaee8c-5716-499c-90dd-7b1f72d55606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.761557 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaee8c-5716-499c-90dd-7b1f72d55606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.763161 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaee8c-5716-499c-90dd-7b1f72d55606 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.769641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d34df8-49ae-4d6d-85d3-6f771a7f4c4e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.775220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1378/2739] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:53.778003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f09e0-0dbd-42c1-a136-5c50a454acd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.778628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f09e0-0dbd-42c1-a136-5c50a454acd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.779030 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f09e0-0dbd-42c1-a136-5c50a454acd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.779119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaee8c-5716-499c-90dd-7b1f72d55606 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.779289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f09e0-0dbd-42c1-a136-5c50a454acd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.779867 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f09e0-0dbd-42c1-a136-5c50a454acd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.784226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f09e0-0dbd-42c1-a136-5c50a454acd0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.795104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaee8c-5716-499c-90dd-7b1f72d55606 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.801451 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1362/2740] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:34:53.803002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f09e0-0dbd-42c1-a136-5c50a454acd0 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.805538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd0e3-99e9-415c-9248-1d0114e5465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.806202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd0e3-99e9-415c-9248-1d0114e5465e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.806640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd0e3-99e9-415c-9248-1d0114e5465e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.806934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd0e3-99e9-415c-9248-1d0114e5465e admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.807589 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dd0e3-99e9-415c-9248-1d0114e5465e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.809537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dd0e3-99e9-415c-9248-1d0114e5465e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.814514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f09e0-0dbd-42c1-a136-5c50a454acd0 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.820126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854d256-c533-4754-99ad-f7624859f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.820825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854d256-c533-4754-99ad-f7624859f3db admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.821110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854d256-c533-4754-99ad-f7624859f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.821435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854d256-c533-4754-99ad-f7624859f3db admin admin] PATH_INFO: `/v3/projects/15c3d0261f9247858db50d06d24f8a20/users/221d48680b4d4c2dbe0a6fd841c44f01/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.822231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1379/2741] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:53.826491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd0e3-99e9-415c-9248-1d0114e5465e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.826911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854d256-c533-4754-99ad-f7624859f3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c3d0261f9247858db50d06d24f8a20, user_id=221d48680b4d4c2dbe0a6fd841c44f01, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.829693 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854d256-c533-4754-99ad-f7624859f3db admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.833936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:53.842858 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1363/2742] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:53 2022] PUT /identity/v3/projects/15c3d0261f9247858db50d06d24f8a20/users/221d48680b4d4c2dbe0a6fd841c44f01/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:53.844786 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd0e3-99e9-415c-9248-1d0114e5465e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:53.855110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea54ff9-7e19-4afc-9e91-61d714280829 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.855398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea54ff9-7e19-4afc-9e91-61d714280829 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.855657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea54ff9-7e19-4afc-9e91-61d714280829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.889274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-7ea54ff9-7e19-4afc-9e91-61d714280829 None None] MFA Rules not processed for user `221d48680b4d4c2dbe0a6fd841c44f01`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:53.891063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7ea54ff9-7e19-4afc-9e91-61d714280829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:53.914701 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39734048-626e-40a6-b052-0fb9d6841a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:53.915408 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39734048-626e-40a6-b052-0fb9d6841a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.915694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39734048-626e-40a6-b052-0fb9d6841a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.915970 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39734048-626e-40a6-b052-0fb9d6841a86 admin admin] PATH_INFO: `/v3/projects/9b387454b34b4ee8ab618d128949c34e/users/8e490c8ed3a04345896bc5e7a3360540/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.932881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39734048-626e-40a6-b052-0fb9d6841a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b387454b34b4ee8ab618d128949c34e, user_id=8e490c8ed3a04345896bc5e7a3360540, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:53.935819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39734048-626e-40a6-b052-0fb9d6841a86 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:53.950875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1380/2743] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:53 2022] PUT /identity/v3/projects/9b387454b34b4ee8ab618d128949c34e/users/8e490c8ed3a04345896bc5e7a3360540/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:53.956227 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19802808-8890-40b1-947f-b0c5eba9c69a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:53.956585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19802808-8890-40b1-947f-b0c5eba9c69a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:53.956929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19802808-8890-40b1-947f-b0c5eba9c69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:53.976620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-19802808-8890-40b1-947f-b0c5eba9c69a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:53.977957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-19802808-8890-40b1-947f-b0c5eba9c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:53.980189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1364/2744] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:53.993708 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea54ff9-7e19-4afc-9e91-61d714280829 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:53.995332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7ea54ff9-7e19-4afc-9e91-61d714280829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:54.054510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1381/2745] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:54.057822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:54.064326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19802808-8890-40b1-947f-b0c5eba9c69a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:54.065832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-19802808-8890-40b1-947f-b0c5eba9c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:54.067450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea54ff9-7e19-4afc-9e91-61d714280829 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:54.124606 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d05161-e6ea-4958-98ad-84f916412b94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:54.125226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05161-e6ea-4958-98ad-84f916412b94 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:54.125542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05161-e6ea-4958-98ad-84f916412b94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:54.125951 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d05161-e6ea-4958-98ad-84f916412b94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:54.127968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19802808-8890-40b1-947f-b0c5eba9c69a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:54.131526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe1427-93ea-4cce-829f-4f2e2d002ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:54.132128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe1427-93ea-4cce-829f-4f2e2d002ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:54.132404 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe1427-93ea-4cce-829f-4f2e2d002ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:54.132674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe1427-93ea-4cce-829f-4f2e2d002ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:54.142030 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe1427-93ea-4cce-829f-4f2e2d002ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:54.143430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe1427-93ea-4cce-829f-4f2e2d002ae8 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:54.152620 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1382/2746] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:34:54.189373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d05161-e6ea-4958-98ad-84f916412b94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:54.190972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d05161-e6ea-4958-98ad-84f916412b94 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:54.203715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1365/2747] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:54.284446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe1427-93ea-4cce-829f-4f2e2d002ae8 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:54.294706 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe1427-93ea-4cce-829f-4f2e2d002ae8 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:54.300666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:54.301324 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:54.301605 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:54.301983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] PATH_INFO: `/v3/users/cd2f43805d9d4bb186fda22203d5dde8` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:54.302995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2f43805d9d4bb186fda22203d5dde8)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:54.304928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:54.330013 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:54.357920 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2f43805d9d4bb186fda22203d5dde8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:54.365624 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2f43805d9d4bb186fda22203d5dde8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:54.366303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2f43805d9d4bb186fda22203d5dde8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:54.379642 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2f43805d9d4bb186fda22203d5dde8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:54.386700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2f43805d9d4bb186fda22203d5dde8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:54.393496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1383/2748] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:34:54 2022] DELETE /identity/v3/users/cd2f43805d9d4bb186fda22203d5dde8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:54.398060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cdb64-ee5d-40ab-88b2-68433c91c4e8 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:54.398357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cdb64-ee5d-40ab-88b2-68433c91c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:54.398641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cdb64-ee5d-40ab-88b2-68433c91c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:54.417888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-d07cdb64-ee5d-40ab-88b2-68433c91c4e8 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:54.419124 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d07cdb64-ee5d-40ab-88b2-68433c91c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:54.480706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1366/2749] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:34:54.490775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:54.492253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:54.555310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c0c2-2d88-447c-8555-5c256483b7bb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:54.559139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03a432-6a8b-4b2f-8170-e8267d7be0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:54.559771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03a432-6a8b-4b2f-8170-e8267d7be0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:54.560053 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03a432-6a8b-4b2f-8170-e8267d7be0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:54.560330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03a432-6a8b-4b2f-8170-e8267d7be0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:54.570993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03a432-6a8b-4b2f-8170-e8267d7be0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:54.572446 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03a432-6a8b-4b2f-8170-e8267d7be0d6 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:54.584155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1384/2750] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:55.008871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cdb64-ee5d-40ab-88b2-68433c91c4e8 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:55.010795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d07cdb64-ee5d-40ab-88b2-68433c91c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:55.031261 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cdb64-ee5d-40ab-88b2-68433c91c4e8 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:55.038398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:55.039272 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:55.040166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:55.040601 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] PATH_INFO: `/v3/projects/75b6b02a14fc47d297f9a5ab880d8a4f` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:55.042041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b6b02a14fc47d297f9a5ab880d8a4f)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:55.044116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:55.123928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:55.126925 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b6b02a14fc47d297f9a5ab880d8a4f', 'request_id': 'req-0ab276b6-5048-4bcd-913e-c4df093c0c7e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.139829 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b6b02a14fc47d297f9a5ab880d8a4f', 'request_id': 'req-0ab276b6-5048-4bcd-913e-c4df093c0c7e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.153659 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b6b02a14fc47d297f9a5ab880d8a4f', 'request_id': 'req-0ab276b6-5048-4bcd-913e-c4df093c0c7e'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.168922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] The token cache is being invalidate because project 75b6b02a14fc47d297f9a5ab880d8a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:34:55.169225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.169971 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.175641 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1367/2751] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:34:55 2022] DELETE /identity/v3/projects/75b6b02a14fc47d297f9a5ab880d8a4f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:55.177106 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03a432-6a8b-4b2f-8170-e8267d7be0d6 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:55.193413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03a432-6a8b-4b2f-8170-e8267d7be0d6 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:55.302031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:55.302702 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:55.303043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:55.303468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] PATH_INFO: `/v3/users/221d48680b4d4c2dbe0a6fd841c44f01` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:55.305314 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221d48680b4d4c2dbe0a6fd841c44f01)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:55.310362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:55.369262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:55.371741 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221d48680b4d4c2dbe0a6fd841c44f01'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.384964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221d48680b4d4c2dbe0a6fd841c44f01'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.386758 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221d48680b4d4c2dbe0a6fd841c44f01'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.413581 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221d48680b4d4c2dbe0a6fd841c44f01'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.430983 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-04ced0ad-81f5-4799-93fc-7762254ec486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221d48680b4d4c2dbe0a6fd841c44f01'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.439632 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1385/2752] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:34:55 2022] DELETE /identity/v3/users/221d48680b4d4c2dbe0a6fd841c44f01 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:55.751965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:55.754931 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:55.775535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab276b6-5048-4bcd-913e-c4df093c0c7e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:55.855762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:55.856356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:55.856648 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:55.856950 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] PATH_INFO: `/v3/projects/15c3d0261f9247858db50d06d24f8a20` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:55.858131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c3d0261f9247858db50d06d24f8a20)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:55.860638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:55.923831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c3d0261f9247858db50d06d24f8a20', 'request_id': 'req-4f241a05-da8b-4b6e-b404-f14268074527'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.937881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c3d0261f9247858db50d06d24f8a20', 'request_id': 'req-4f241a05-da8b-4b6e-b404-f14268074527'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.949605 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c3d0261f9247858db50d06d24f8a20', 'request_id': 'req-4f241a05-da8b-4b6e-b404-f14268074527'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.967538 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] The token cache is being invalidate because project 15c3d0261f9247858db50d06d24f8a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:34:55.967832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.969203 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-4f241a05-da8b-4b6e-b404-f14268074527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:34:55.971001 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1368/2753] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:34:55 2022] DELETE /identity/v3/projects/15c3d0261f9247858db50d06d24f8a20 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:55.976690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b974e8-af9c-461d-a05e-40327a38938c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:55.977206 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b974e8-af9c-461d-a05e-40327a38938c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:55.977343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b974e8-af9c-461d-a05e-40327a38938c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:55.997562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a8b974e8-af9c-461d-a05e-40327a38938c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:55.998785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a8b974e8-af9c-461d-a05e-40327a38938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:56.064999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1386/2754] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:56.072953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418caef-8690-414b-b0b7-f8293663db77 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.073439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418caef-8690-414b-b0b7-f8293663db77 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.073565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418caef-8690-414b-b0b7-f8293663db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.102004 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-f418caef-8690-414b-b0b7-f8293663db77 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:56.103607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-f418caef-8690-414b-b0b7-f8293663db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:56.113923 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1369/2755] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:56.119336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b974e8-af9c-461d-a05e-40327a38938c None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.131156 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b974e8-af9c-461d-a05e-40327a38938c None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:56.136710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225e023-4126-450f-b207-61bbd980a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:56.137401 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225e023-4126-450f-b207-61bbd980a5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.137685 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225e023-4126-450f-b207-61bbd980a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.137964 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225e023-4126-450f-b207-61bbd980a5b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.138634 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225e023-4126-450f-b207-61bbd980a5b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:34:56.138945 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225e023-4126-450f-b207-61bbd980a5b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:56.141157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225e023-4126-450f-b207-61bbd980a5b1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:56.161859 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1387/2756] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:34:56.162131 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418caef-8690-414b-b0b7-f8293663db77 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.185389 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418caef-8690-414b-b0b7-f8293663db77 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:56.200488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b567-6539-4ef9-8c57-303d8409ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:56.201358 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b567-6539-4ef9-8c57-303d8409ef20 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.201866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b567-6539-4ef9-8c57-303d8409ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.202329 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b567-6539-4ef9-8c57-303d8409ef20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.204766 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b567-6539-4ef9-8c57-303d8409ef20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:56.206749 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b567-6539-4ef9-8c57-303d8409ef20 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:56.245585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1370/2757] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:34:56 2022] POST /identity/v3/projects => generated 399 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:34:56.249770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225e023-4126-450f-b207-61bbd980a5b1 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.260112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225e023-4126-450f-b207-61bbd980a5b1 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:56.327231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f65bf-eb71-4c21-b055-21b1a6ba8570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:56.328565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f65bf-eb71-4c21-b055-21b1a6ba8570 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.328862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f65bf-eb71-4c21-b055-21b1a6ba8570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.329138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f65bf-eb71-4c21-b055-21b1a6ba8570 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.329827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f65bf-eb71-4c21-b055-21b1a6ba8570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:56.331769 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f65bf-eb71-4c21-b055-21b1a6ba8570 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:56.363707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1388/2758] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:34:56 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:34:56.387511 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b567-6539-4ef9-8c57-303d8409ef20 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.407266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b567-6539-4ef9-8c57-303d8409ef20 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:56.416279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72a3f7-4465-4b02-862a-f38c1bcc63aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:56.417207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72a3f7-4465-4b02-862a-f38c1bcc63aa admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.417985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72a3f7-4465-4b02-862a-f38c1bcc63aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.418450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72a3f7-4465-4b02-862a-f38c1bcc63aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.420425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72a3f7-4465-4b02-862a-f38c1bcc63aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:56.426284 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72a3f7-4465-4b02-862a-f38c1bcc63aa admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:56.438121 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1371/2759] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:34:56.442373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f65bf-eb71-4c21-b055-21b1a6ba8570 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.458231 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f65bf-eb71-4c21-b055-21b1a6ba8570 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:56.469929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc451c-c389-41db-a28b-03df878faa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:56.470680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc451c-c389-41db-a28b-03df878faa1d admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.471050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc451c-c389-41db-a28b-03df878faa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.471405 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc451c-c389-41db-a28b-03df878faa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.472600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc451c-c389-41db-a28b-03df878faa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:56.475197 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc451c-c389-41db-a28b-03df878faa1d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:56.493187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1389/2760] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:56.497506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72a3f7-4465-4b02-862a-f38c1bcc63aa admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.507864 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72a3f7-4465-4b02-862a-f38c1bcc63aa admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:56.529667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4c7e1-ef47-4375-87c7-13b00405ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:56.530370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4c7e1-ef47-4375-87c7-13b00405ec95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.531218 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4c7e1-ef47-4375-87c7-13b00405ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.531514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4c7e1-ef47-4375-87c7-13b00405ec95 admin admin] PATH_INFO: `/v3/projects/5bf6f37c60ba4e8590d980cd52c220f9/users/14c890a6bfb0401ca46bb6a0d50949e8/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.549907 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4c7e1-ef47-4375-87c7-13b00405ec95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf6f37c60ba4e8590d980cd52c220f9, user_id=14c890a6bfb0401ca46bb6a0d50949e8, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:56.552579 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4c7e1-ef47-4375-87c7-13b00405ec95 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:56.569317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1372/2761] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:56 2022] PUT /identity/v3/projects/5bf6f37c60ba4e8590d980cd52c220f9/users/14c890a6bfb0401ca46bb6a0d50949e8/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:56.579873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba445638-eecb-4c54-a9f9-54d9daaf4772 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.580264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba445638-eecb-4c54-a9f9-54d9daaf4772 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.580722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba445638-eecb-4c54-a9f9-54d9daaf4772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.611237 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ba445638-eecb-4c54-a9f9-54d9daaf4772 None None] MFA Rules not processed for user `14c890a6bfb0401ca46bb6a0d50949e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:56.612416 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ba445638-eecb-4c54-a9f9-54d9daaf4772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:56.632135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:56.688914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1390/2762] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:56.693464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4c7e1-ef47-4375-87c7-13b00405ec95 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.703239 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:56.764474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4c7e1-ef47-4375-87c7-13b00405ec95 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:56.769783 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d18a6-602e-4e0f-ae44-beb560240422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:56.770427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d18a6-602e-4e0f-ae44-beb560240422 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.770713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d18a6-602e-4e0f-ae44-beb560240422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.771032 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d18a6-602e-4e0f-ae44-beb560240422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.771684 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d18a6-602e-4e0f-ae44-beb560240422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:56.773611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d18a6-602e-4e0f-ae44-beb560240422 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:56.804625 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1373/2763] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:34:56 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:56.808771 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba445638-eecb-4c54-a9f9-54d9daaf4772 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.820372 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba445638-eecb-4c54-a9f9-54d9daaf4772 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:56.886748 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1523-4df9-4f43-809d-6cb716e533bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:56.887294 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1523-4df9-4f43-809d-6cb716e533bb admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.887603 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1523-4df9-4f43-809d-6cb716e533bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.887881 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1523-4df9-4f43-809d-6cb716e533bb admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.888535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1523-4df9-4f43-809d-6cb716e533bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:56.892037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1523-4df9-4f43-809d-6cb716e533bb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:56.922163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1391/2764] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:34:56 2022] POST /identity/v3/users => generated 307 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:34:56.925811 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d18a6-602e-4e0f-ae44-beb560240422 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.942472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d18a6-602e-4e0f-ae44-beb560240422 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:56.949874 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d054d-cf44-49a5-859c-52634c7ee0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:56.950886 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d054d-cf44-49a5-859c-52634c7ee0af admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:56.951328 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d054d-cf44-49a5-859c-52634c7ee0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:56.951786 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d054d-cf44-49a5-859c-52634c7ee0af admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:56.953136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d054d-cf44-49a5-859c-52634c7ee0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:56.955259 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d054d-cf44-49a5-859c-52634c7ee0af admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:56.976598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1374/2765] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:56.980822 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1523-4df9-4f43-809d-6cb716e533bb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:56.993747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1523-4df9-4f43-809d-6cb716e533bb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:57.002779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115cd6e-6c65-45bc-be6e-b9c43af3116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:57.003612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115cd6e-6c65-45bc-be6e-b9c43af3116d admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:57.003999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115cd6e-6c65-45bc-be6e-b9c43af3116d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:57.004412 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115cd6e-6c65-45bc-be6e-b9c43af3116d admin admin] PATH_INFO: `/v3/projects/38a3f794f72b4b01b57ea4fe32ff66ff/users/37f0ab9b8b18478498177f8f6ba26023/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:57.029794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115cd6e-6c65-45bc-be6e-b9c43af3116d admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a3f794f72b4b01b57ea4fe32ff66ff, user_id=37f0ab9b8b18478498177f8f6ba26023, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:57.033261 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115cd6e-6c65-45bc-be6e-b9c43af3116d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:57.050400 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1392/2766] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:56 2022] PUT /identity/v3/projects/38a3f794f72b4b01b57ea4fe32ff66ff/users/37f0ab9b8b18478498177f8f6ba26023/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:57.054722 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d054d-cf44-49a5-859c-52634c7ee0af admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:57.073757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d054d-cf44-49a5-859c-52634c7ee0af admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:57.158189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ed91e-80af-4f1f-95af-e5dd9a07cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:57.158838 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed91e-80af-4f1f-95af-e5dd9a07cae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:57.159172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed91e-80af-4f1f-95af-e5dd9a07cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:57.159461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed91e-80af-4f1f-95af-e5dd9a07cae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:57.160717 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ed91e-80af-4f1f-95af-e5dd9a07cae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:57.162383 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ed91e-80af-4f1f-95af-e5dd9a07cae5 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:57.175249 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1375/2767] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:34:57.178914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115cd6e-6c65-45bc-be6e-b9c43af3116d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:57.195535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115cd6e-6c65-45bc-be6e-b9c43af3116d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:57.202928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c79e-1137-4c65-8677-3d9facb77005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:57.204286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c79e-1137-4c65-8677-3d9facb77005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:57.204571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c79e-1137-4c65-8677-3d9facb77005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:57.204849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c79e-1137-4c65-8677-3d9facb77005 admin admin] PATH_INFO: `/v3/projects/38a3f794f72b4b01b57ea4fe32ff66ff/users/37f0ab9b8b18478498177f8f6ba26023/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:57.208838 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30c79e-1137-4c65-8677-3d9facb77005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a3f794f72b4b01b57ea4fe32ff66ff, user_id=37f0ab9b8b18478498177f8f6ba26023, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:57.213479 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30c79e-1137-4c65-8677-3d9facb77005 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:57.244580 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1393/2768] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:34:57 2022] PUT /identity/v3/projects/38a3f794f72b4b01b57ea4fe32ff66ff/users/37f0ab9b8b18478498177f8f6ba26023/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:34:57.247322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5879-9b6e-4410-94dc-f808ab6d7a23 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:57.247690 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5879-9b6e-4410-94dc-f808ab6d7a23 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:57.248040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5879-9b6e-4410-94dc-f808ab6d7a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:57.290062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-320b5879-9b6e-4410-94dc-f808ab6d7a23 None None] MFA Rules not processed for user `37f0ab9b8b18478498177f8f6ba26023`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:57.291311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-320b5879-9b6e-4410-94dc-f808ab6d7a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:57.381863 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:57.388333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1376/2769] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:57 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:57.399554 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c79e-1137-4c65-8677-3d9facb77005 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:57.401483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2d30c79e-1137-4c65-8677-3d9facb77005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:57.480362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c79e-1137-4c65-8677-3d9facb77005 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:57.484680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d25b-4c24-4b8e-b41d-4f032c0d2b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:57.485437 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d25b-4c24-4b8e-b41d-4f032c0d2b49 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:57.485799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d25b-4c24-4b8e-b41d-4f032c0d2b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:57.486606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d25b-4c24-4b8e-b41d-4f032c0d2b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:57.496705 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d25b-4c24-4b8e-b41d-4f032c0d2b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:57.498298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d25b-4c24-4b8e-b41d-4f032c0d2b49 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:57.509444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1394/2770] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:57 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:57.595619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b5879-9b6e-4410-94dc-f808ab6d7a23 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:57.607661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b5879-9b6e-4410-94dc-f808ab6d7a23 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:57.612878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af2c72-75a8-481f-816b-25c8d370d06f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:57.614073 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2c72-75a8-481f-816b-25c8d370d06f service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:57.614479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2c72-75a8-481f-816b-25c8d370d06f service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:57.614877 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2c72-75a8-481f-816b-25c8d370d06f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:57.717593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af2c72-75a8-481f-816b-25c8d370d06f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:57.720139 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af2c72-75a8-481f-816b-25c8d370d06f service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:57.747201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1377/2771] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:34:58.895993 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce537d-a397-46b0-b22b-1c6552e491bb None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:58.896847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce537d-a397-46b0-b22b-1c6552e491bb None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:58.897116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce537d-a397-46b0-b22b-1c6552e491bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:58.931757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:34:58.935464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-82ce537d-a397-46b0-b22b-1c6552e491bb None None] MFA Rules not processed for user `8e490c8ed3a04345896bc5e7a3360540`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:34:58.936855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-82ce537d-a397-46b0-b22b-1c6552e491bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:59.008918 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1395/2772] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:34:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:34:59.027502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af2c72-75a8-481f-816b-25c8d370d06f service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:34:59.028975 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-31af2c72-75a8-481f-816b-25c8d370d06f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:34:59.114068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af2c72-75a8-481f-816b-25c8d370d06f service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:34:59.132494 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545a018-6fe4-42f1-bfa2-d376b4c048ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:34:59.133148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545a018-6fe4-42f1-bfa2-d376b4c048ff service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:34:59.133466 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545a018-6fe4-42f1-bfa2-d376b4c048ff service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:34:59.133977 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545a018-6fe4-42f1-bfa2-d376b4c048ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:34:59.143563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545a018-6fe4-42f1-bfa2-d376b4c048ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:34:59.145168 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545a018-6fe4-42f1-bfa2-d376b4c048ff service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:34:59.155480 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1378/2773] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:34:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:35:00.555630 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ca84c-05ae-43c6-a15e-0501626ebd62 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:00.556082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ca84c-05ae-43c6-a15e-0501626ebd62 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:00.556200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ca84c-05ae-43c6-a15e-0501626ebd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:00.575653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-675ca84c-05ae-43c6-a15e-0501626ebd62 None None] MFA Rules not processed for user `8e490c8ed3a04345896bc5e7a3360540`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:00.576846 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-675ca84c-05ae-43c6-a15e-0501626ebd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:00.583952 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1396/2774] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:02.160378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545a018-6fe4-42f1-bfa2-d376b4c048ff service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:02.270338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545a018-6fe4-42f1-bfa2-d376b4c048ff service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:02.276361 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:02.277337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:02.277841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:02.278315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] PATH_INFO: `/v3/users/14c890a6bfb0401ca46bb6a0d50949e8` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:02.279697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c890a6bfb0401ca46bb6a0d50949e8)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:02.282523 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:02.323289 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:02.362135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c890a6bfb0401ca46bb6a0d50949e8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:02.372696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c890a6bfb0401ca46bb6a0d50949e8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:02.375568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c890a6bfb0401ca46bb6a0d50949e8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:02.408945 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c890a6bfb0401ca46bb6a0d50949e8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:02.433506 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c890a6bfb0401ca46bb6a0d50949e8'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:02.451861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1379/2775] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:35:02 2022] DELETE /identity/v3/users/14c890a6bfb0401ca46bb6a0d50949e8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:02.458832 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b95c5-b58a-42d1-9e7f-46cc2d743074 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:02.459438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b95c5-b58a-42d1-9e7f-46cc2d743074 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:02.460612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b95c5-b58a-42d1-9e7f-46cc2d743074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:02.505518 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-379b95c5-b58a-42d1-9e7f-46cc2d743074 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:02.507000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-379b95c5-b58a-42d1-9e7f-46cc2d743074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:02.581220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1397/2776] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:02.591933 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:02.594101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:02.695597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0803f-d19d-4bc6-b270-d8a0350fbc79 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:02.700529 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa3e9c-5351-433e-a8aa-be9e6ab7c4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:02.701268 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa3e9c-5351-433e-a8aa-be9e6ab7c4eb service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:02.701757 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa3e9c-5351-433e-a8aa-be9e6ab7c4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:02.702125 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa3e9c-5351-433e-a8aa-be9e6ab7c4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:02.714970 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa3e9c-5351-433e-a8aa-be9e6ab7c4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:02.717405 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa3e9c-5351-433e-a8aa-be9e6ab7c4eb service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:02.733371 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1380/2777] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:35:03.089094 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b95c5-b58a-42d1-9e7f-46cc2d743074 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:03.090747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-379b95c5-b58a-42d1-9e7f-46cc2d743074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:03.114883 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b95c5-b58a-42d1-9e7f-46cc2d743074 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:03.123172 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:03.123839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:03.124128 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:03.124973 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] PATH_INFO: `/v3/projects/5bf6f37c60ba4e8590d980cd52c220f9` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:03.135885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf6f37c60ba4e8590d980cd52c220f9)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:03.138208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:03.199292 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf6f37c60ba4e8590d980cd52c220f9', 'request_id': 'req-8196fe91-dee7-49a7-b72a-b6633e2e71d7'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.206064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf6f37c60ba4e8590d980cd52c220f9', 'request_id': 'req-8196fe91-dee7-49a7-b72a-b6633e2e71d7'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.212414 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf6f37c60ba4e8590d980cd52c220f9', 'request_id': 'req-8196fe91-dee7-49a7-b72a-b6633e2e71d7'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.229499 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] The token cache is being invalidate because project 5bf6f37c60ba4e8590d980cd52c220f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:35:03.229798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.231861 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.234990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1398/2778] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:35:03 2022] DELETE /identity/v3/projects/5bf6f37c60ba4e8590d980cd52c220f9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:03.239029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa3e9c-5351-433e-a8aa-be9e6ab7c4eb service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:03.253189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa3e9c-5351-433e-a8aa-be9e6ab7c4eb service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:03.361467 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:03.362346 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:03.362623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:03.363065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] PATH_INFO: `/v3/users/37f0ab9b8b18478498177f8f6ba26023` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:03.364403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f0ab9b8b18478498177f8f6ba26023)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:03.366687 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:03.428204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:03.431398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f0ab9b8b18478498177f8f6ba26023'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.445274 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f0ab9b8b18478498177f8f6ba26023'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.446420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f0ab9b8b18478498177f8f6ba26023'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.460928 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f0ab9b8b18478498177f8f6ba26023'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.472663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-58b4a289-87ab-4e0e-b801-dd4f720a28a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f0ab9b8b18478498177f8f6ba26023'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:03.478896 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1381/2779] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:35:03 2022] DELETE /identity/v3/users/37f0ab9b8b18478498177f8f6ba26023 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:03.888424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:03.890064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:03.907267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196fe91-dee7-49a7-b72a-b6633e2e71d7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:03.927458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:03.971050 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:03.971703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:03.971990 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:03.972270 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] PATH_INFO: `/v3/projects/38a3f794f72b4b01b57ea4fe32ff66ff` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:03.973515 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a3f794f72b4b01b57ea4fe32ff66ff)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:03.975478 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:04.025948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a3f794f72b4b01b57ea4fe32ff66ff', 'request_id': 'req-65469f97-ffc4-431b-8b97-fd4c3a63e64f'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:04.033582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a3f794f72b4b01b57ea4fe32ff66ff', 'request_id': 'req-65469f97-ffc4-431b-8b97-fd4c3a63e64f'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:04.040675 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a3f794f72b4b01b57ea4fe32ff66ff', 'request_id': 'req-65469f97-ffc4-431b-8b97-fd4c3a63e64f'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:04.054516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] The token cache is being invalidate because project 38a3f794f72b4b01b57ea4fe32ff66ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:35:04.054812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:04.055459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-65469f97-ffc4-431b-8b97-fd4c3a63e64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:04.057220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1399/2780] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:35:03 2022] DELETE /identity/v3/projects/38a3f794f72b4b01b57ea4fe32ff66ff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:04.061966 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b192654-0281-4ce2-b6bf-f77c69585f46 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.062332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b192654-0281-4ce2-b6bf-f77c69585f46 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.062682 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b192654-0281-4ce2-b6bf-f77c69585f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.083712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-5b192654-0281-4ce2-b6bf-f77c69585f46 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:04.084934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-5b192654-0281-4ce2-b6bf-f77c69585f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:04.151642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1382/2781] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:04.159956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a108b-d224-4cef-980d-30ee156adb9c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.160237 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a108b-d224-4cef-980d-30ee156adb9c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.160585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a108b-d224-4cef-980d-30ee156adb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.182395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-ef7a108b-d224-4cef-980d-30ee156adb9c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:04.189736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-ef7a108b-d224-4cef-980d-30ee156adb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:04.202694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1400/2782] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:04.203911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b192654-0281-4ce2-b6bf-f77c69585f46 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:04.219530 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b192654-0281-4ce2-b6bf-f77c69585f46 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:04.225767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa003b-5dd9-445d-9f15-71080fcaaee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:04.226570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa003b-5dd9-445d-9f15-71080fcaaee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.227191 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa003b-5dd9-445d-9f15-71080fcaaee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.227626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa003b-5dd9-445d-9f15-71080fcaaee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.228434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa003b-5dd9-445d-9f15-71080fcaaee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:35:04.228900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa003b-5dd9-445d-9f15-71080fcaaee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:04.231019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa003b-5dd9-445d-9f15-71080fcaaee8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:04.247890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1383/2783] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:35:04.253381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a108b-d224-4cef-980d-30ee156adb9c None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:04.262894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a108b-d224-4cef-980d-30ee156adb9c None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:04.267762 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107b448-a0c6-4bcf-8ccf-fa0c6ca7e507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:04.268549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107b448-a0c6-4bcf-8ccf-fa0c6ca7e507 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.268839 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107b448-a0c6-4bcf-8ccf-fa0c6ca7e507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.269122 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107b448-a0c6-4bcf-8ccf-fa0c6ca7e507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.269796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107b448-a0c6-4bcf-8ccf-fa0c6ca7e507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:04.271704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107b448-a0c6-4bcf-8ccf-fa0c6ca7e507 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:04.309594 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1401/2784] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:35:04 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:35:04.314404 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa003b-5dd9-445d-9f15-71080fcaaee8 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:04.330700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa003b-5dd9-445d-9f15-71080fcaaee8 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:04.394815 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab76da-3dbc-4491-8a4d-60596da61ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:04.395664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab76da-3dbc-4491-8a4d-60596da61ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.396638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab76da-3dbc-4491-8a4d-60596da61ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.396992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab76da-3dbc-4491-8a4d-60596da61ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.398089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab76da-3dbc-4491-8a4d-60596da61ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:04.400225 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab76da-3dbc-4491-8a4d-60596da61ac6 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:04.425019 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1384/2785] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:35:04 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:35:04.429253 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107b448-a0c6-4bcf-8ccf-fa0c6ca7e507 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:04.440532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107b448-a0c6-4bcf-8ccf-fa0c6ca7e507 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:04.445851 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3950ec-d39f-46b3-b363-2145f9eb91b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:04.446458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3950ec-d39f-46b3-b363-2145f9eb91b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.446742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3950ec-d39f-46b3-b363-2145f9eb91b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.447022 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3950ec-d39f-46b3-b363-2145f9eb91b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.447666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3950ec-d39f-46b3-b363-2145f9eb91b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:04.449267 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3950ec-d39f-46b3-b363-2145f9eb91b3 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:04.459718 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1402/2786] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:35:04.463755 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab76da-3dbc-4491-8a4d-60596da61ac6 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:04.474595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab76da-3dbc-4491-8a4d-60596da61ac6 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:04.479244 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15b1f-2fb1-4061-889a-cab0024e93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:04.479854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15b1f-2fb1-4061-889a-cab0024e93da admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.480140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15b1f-2fb1-4061-889a-cab0024e93da admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.480416 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15b1f-2fb1-4061-889a-cab0024e93da admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.481052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b15b1f-2fb1-4061-889a-cab0024e93da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:04.482677 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b15b1f-2fb1-4061-889a-cab0024e93da admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:04.493415 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1385/2787] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:35:04.497773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3950ec-d39f-46b3-b363-2145f9eb91b3 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:04.508063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3950ec-d39f-46b3-b363-2145f9eb91b3 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:04.513041 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb712ce-7414-4650-958a-5318d42d667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:04.513746 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb712ce-7414-4650-958a-5318d42d667d admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.514028 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb712ce-7414-4650-958a-5318d42d667d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.514330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb712ce-7414-4650-958a-5318d42d667d admin admin] PATH_INFO: `/v3/projects/f936f72457734e89ab33622db4050d7b/users/fe03ae011f534d3e8c08e55052e0d10d/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.530200 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb712ce-7414-4650-958a-5318d42d667d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f936f72457734e89ab33622db4050d7b, user_id=fe03ae011f534d3e8c08e55052e0d10d, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:04.533459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb712ce-7414-4650-958a-5318d42d667d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:04.548903 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1403/2788] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:35:04 2022] PUT /identity/v3/projects/f936f72457734e89ab33622db4050d7b/users/fe03ae011f534d3e8c08e55052e0d10d/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:04.560223 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127330d-2097-49b7-9f37-1a6025609a6a None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.560583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127330d-2097-49b7-9f37-1a6025609a6a None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.560919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127330d-2097-49b7-9f37-1a6025609a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.590135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1127330d-2097-49b7-9f37-1a6025609a6a None None] MFA Rules not processed for user `fe03ae011f534d3e8c08e55052e0d10d`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:04.591502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1127330d-2097-49b7-9f37-1a6025609a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:04.610885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:04.664661 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1386/2789] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:04.676287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb712ce-7414-4650-958a-5318d42d667d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:04.678044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9bb712ce-7414-4650-958a-5318d42d667d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:04.730079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:04.736810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb712ce-7414-4650-958a-5318d42d667d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:04.740947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ad198-db94-4d08-bd4a-137c8883e8ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:04.741585 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ad198-db94-4d08-bd4a-137c8883e8ee service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:04.741873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ad198-db94-4d08-bd4a-137c8883e8ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:04.742152 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ad198-db94-4d08-bd4a-137c8883e8ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:04.750997 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ad198-db94-4d08-bd4a-137c8883e8ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:04.752420 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ad198-db94-4d08-bd4a-137c8883e8ee service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:04.761381 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1404/2790] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:35:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:35:14.662439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=19 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:14.757279 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:18.343246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127330d-2097-49b7-9f37-1a6025609a6a None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:18.403795 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127330d-2097-49b7-9f37-1a6025609a6a None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:18.408822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:18.409479 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:18.409765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:18.410040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] PATH_INFO: `/v3/users/fe03ae011f534d3e8c08e55052e0d10d` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:18.411174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe03ae011f534d3e8c08e55052e0d10d)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:18.413071 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:18.460570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe03ae011f534d3e8c08e55052e0d10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:18.467551 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe03ae011f534d3e8c08e55052e0d10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:18.468171 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe03ae011f534d3e8c08e55052e0d10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:18.480378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe03ae011f534d3e8c08e55052e0d10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:18.487704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe03ae011f534d3e8c08e55052e0d10d'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:18.493520 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1387/2791] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:35:18 2022] DELETE /identity/v3/users/fe03ae011f534d3e8c08e55052e0d10d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:18.498379 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe7cc1-7996-4d5c-9fa8-e6a75efd44dd None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:18.498868 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe7cc1-7996-4d5c-9fa8-e6a75efd44dd None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:18.498984 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe7cc1-7996-4d5c-9fa8-e6a75efd44dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:18.517413 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-54fe7cc1-7996-4d5c-9fa8-e6a75efd44dd None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:18.518612 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-54fe7cc1-7996-4d5c-9fa8-e6a75efd44dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:18.577099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1405/2792] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:18.586784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:18.588170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:18.644243 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a579ae-4b7d-4f0f-8267-952a1d37927a admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:18.647815 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb17ae-e86e-472c-b36e-aa7781713113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:18.648445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb17ae-e86e-472c-b36e-aa7781713113 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:18.648723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb17ae-e86e-472c-b36e-aa7781713113 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:18.648995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb17ae-e86e-472c-b36e-aa7781713113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:18.658369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb17ae-e86e-472c-b36e-aa7781713113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:18.659832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb17ae-e86e-472c-b36e-aa7781713113 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:18.669486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1388/2793] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:35:18.938570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe7cc1-7996-4d5c-9fa8-e6a75efd44dd None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:18.940067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-54fe7cc1-7996-4d5c-9fa8-e6a75efd44dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:18.952290 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe7cc1-7996-4d5c-9fa8-e6a75efd44dd None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:18.959199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:18.959858 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:18.960139 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:18.960820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] PATH_INFO: `/v3/projects/f936f72457734e89ab33622db4050d7b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:18.962363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f936f72457734e89ab33622db4050d7b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:18.964186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:19.013286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f936f72457734e89ab33622db4050d7b', 'request_id': 'req-830794c6-6d82-4a3d-afb3-c185ab7b6775'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:19.019434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f936f72457734e89ab33622db4050d7b', 'request_id': 'req-830794c6-6d82-4a3d-afb3-c185ab7b6775'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:19.024931 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f936f72457734e89ab33622db4050d7b', 'request_id': 'req-830794c6-6d82-4a3d-afb3-c185ab7b6775'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:19.038716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] The token cache is being invalidate because project f936f72457734e89ab33622db4050d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:35:19.038999 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:19.039653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-830794c6-6d82-4a3d-afb3-c185ab7b6775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:19.041205 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1406/2794] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:35:18 2022] DELETE /identity/v3/projects/f936f72457734e89ab33622db4050d7b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:19.048212 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4596ae-c0f3-49d1-8cd5-2cd77e66ec42 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.048499 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4596ae-c0f3-49d1-8cd5-2cd77e66ec42 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.048775 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4596ae-c0f3-49d1-8cd5-2cd77e66ec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.069926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-8c4596ae-c0f3-49d1-8cd5-2cd77e66ec42 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:19.071136 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-8c4596ae-c0f3-49d1-8cd5-2cd77e66ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:19.087927 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:19.131683 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1389/2795] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:19.139444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ed41d-a942-4557-9949-31ff909e1ed1 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.139735 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ed41d-a942-4557-9949-31ff909e1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.140014 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ed41d-a942-4557-9949-31ff909e1ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.159904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-a88ed41d-a942-4557-9949-31ff909e1ed1 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:19.161116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a88ed41d-a942-4557-9949-31ff909e1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:19.169018 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1407/2796] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:19.173872 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4596ae-c0f3-49d1-8cd5-2cd77e66ec42 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:19.183396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4596ae-c0f3-49d1-8cd5-2cd77e66ec42 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:19.188034 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16357e8f-44c7-4c15-840b-cbd23d2b31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:19.188639 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16357e8f-44c7-4c15-840b-cbd23d2b31ae admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.188924 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16357e8f-44c7-4c15-840b-cbd23d2b31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.189201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16357e8f-44c7-4c15-840b-cbd23d2b31ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.189871 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16357e8f-44c7-4c15-840b-cbd23d2b31ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:35:19.190179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16357e8f-44c7-4c15-840b-cbd23d2b31ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:19.191767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16357e8f-44c7-4c15-840b-cbd23d2b31ae admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:19.203085 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1390/2797] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:35:19.207458 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ed41d-a942-4557-9949-31ff909e1ed1 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:19.216761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ed41d-a942-4557-9949-31ff909e1ed1 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:19.221981 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e2df9-8dc1-457d-8604-055d297c4aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:19.222586 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e2df9-8dc1-457d-8604-055d297c4aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.222869 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e2df9-8dc1-457d-8604-055d297c4aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.223143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e2df9-8dc1-457d-8604-055d297c4aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.223783 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e2df9-8dc1-457d-8604-055d297c4aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:19.225699 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e2df9-8dc1-457d-8604-055d297c4aeb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:19.253358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1408/2798] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:35:19 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:35:19.257833 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16357e8f-44c7-4c15-840b-cbd23d2b31ae admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:19.267835 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16357e8f-44c7-4c15-840b-cbd23d2b31ae admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:19.323339 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233da3d6-b143-4b30-b1d7-decf57951d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:19.323947 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233da3d6-b143-4b30-b1d7-decf57951d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.324231 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233da3d6-b143-4b30-b1d7-decf57951d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.324507 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233da3d6-b143-4b30-b1d7-decf57951d5d admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.325138 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233da3d6-b143-4b30-b1d7-decf57951d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:19.327086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233da3d6-b143-4b30-b1d7-decf57951d5d admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:19.348825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1391/2799] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:35:19 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:35:19.353079 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e2df9-8dc1-457d-8604-055d297c4aeb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:19.364319 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e2df9-8dc1-457d-8604-055d297c4aeb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:19.368862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4bd4a-9665-45c8-8241-cb63f56e11c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:19.369484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4bd4a-9665-45c8-8241-cb63f56e11c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.369767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4bd4a-9665-45c8-8241-cb63f56e11c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.370038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4bd4a-9665-45c8-8241-cb63f56e11c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.370674 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4bd4a-9665-45c8-8241-cb63f56e11c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:19.372510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4bd4a-9665-45c8-8241-cb63f56e11c7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:19.382154 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1409/2800] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:35:19.385849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233da3d6-b143-4b30-b1d7-decf57951d5d admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:19.396017 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233da3d6-b143-4b30-b1d7-decf57951d5d admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:19.400610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284cf1d-ba6c-4707-8e5a-6fd23e20d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:19.401208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284cf1d-ba6c-4707-8e5a-6fd23e20d56a admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.401521 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284cf1d-ba6c-4707-8e5a-6fd23e20d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.401799 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284cf1d-ba6c-4707-8e5a-6fd23e20d56a admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.402433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284cf1d-ba6c-4707-8e5a-6fd23e20d56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:19.404003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284cf1d-ba6c-4707-8e5a-6fd23e20d56a admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:19.414995 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1392/2801] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:35:19.418807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4bd4a-9665-45c8-8241-cb63f56e11c7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:19.429898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4bd4a-9665-45c8-8241-cb63f56e11c7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:19.434523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4306254-6c07-4b05-8878-8b7cc246011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:19.435162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4306254-6c07-4b05-8878-8b7cc246011e admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.435445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4306254-6c07-4b05-8878-8b7cc246011e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.435722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4306254-6c07-4b05-8878-8b7cc246011e admin admin] PATH_INFO: `/v3/projects/ef4ceb15d93941319b1dbf5275a55196/users/8a5199e5a41e48588515396d0be45142/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.449862 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4306254-6c07-4b05-8878-8b7cc246011e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4ceb15d93941319b1dbf5275a55196, user_id=8a5199e5a41e48588515396d0be45142, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:19.452485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4306254-6c07-4b05-8878-8b7cc246011e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:19.465900 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1410/2802] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:35:19 2022] PUT /identity/v3/projects/ef4ceb15d93941319b1dbf5275a55196/users/8a5199e5a41e48588515396d0be45142/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:19.478040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfeead-3472-44e8-a5c9-5511b5c82d4f None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.478335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfeead-3472-44e8-a5c9-5511b5c82d4f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.478638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfeead-3472-44e8-a5c9-5511b5c82d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.506334 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-1cbfeead-3472-44e8-a5c9-5511b5c82d4f None None] MFA Rules not processed for user `8a5199e5a41e48588515396d0be45142`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:19.507548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-1cbfeead-3472-44e8-a5c9-5511b5c82d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:19.571454 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1393/2803] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:19.582640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4306254-6c07-4b05-8878-8b7cc246011e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:19.584433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f4306254-6c07-4b05-8878-8b7cc246011e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:19.606987 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:19.644704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4306254-6c07-4b05-8878-8b7cc246011e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:19.648334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429f58f-6b9e-4f5e-af81-4a82c73d4238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:19.648936 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f58f-6b9e-4f5e-af81-4a82c73d4238 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:19.649219 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f58f-6b9e-4f5e-af81-4a82c73d4238 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:19.649522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f58f-6b9e-4f5e-af81-4a82c73d4238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:19.658278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429f58f-6b9e-4f5e-af81-4a82c73d4238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:19.659713 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429f58f-6b9e-4f5e-af81-4a82c73d4238 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:19.668545 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1411/2804] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:35:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:35:22.737818 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfeead-3472-44e8-a5c9-5511b5c82d4f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:22.756534 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:22.799791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfeead-3472-44e8-a5c9-5511b5c82d4f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:22.804255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:22.804878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:22.805156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:22.805457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] PATH_INFO: `/v3/users/8a5199e5a41e48588515396d0be45142` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:22.806548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5199e5a41e48588515396d0be45142)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:22.808474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:22.853967 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5199e5a41e48588515396d0be45142'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:22.861245 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5199e5a41e48588515396d0be45142'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:22.861906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5199e5a41e48588515396d0be45142'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:22.874441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5199e5a41e48588515396d0be45142'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:22.881911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5199e5a41e48588515396d0be45142'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:22.887702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1394/2805] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:35:22 2022] DELETE /identity/v3/users/8a5199e5a41e48588515396d0be45142 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:22.892779 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcf0d5-94ad-409d-9948-f37034b447fa None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:22.893259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcf0d5-94ad-409d-9948-f37034b447fa None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:22.893361 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcf0d5-94ad-409d-9948-f37034b447fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:22.911942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-3dfcf0d5-94ad-409d-9948-f37034b447fa None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:35:22.913202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3dfcf0d5-94ad-409d-9948-f37034b447fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:22.970063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1412/2806] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:35:22.979570 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:22.980981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:23.037865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0abbe0-6138-4dd4-acbf-4f91666cfa34 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:23.041469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f2afe-bb6e-486d-b61c-7f237f0209ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:23.042066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f2afe-bb6e-486d-b61c-7f237f0209ff service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:23.042345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f2afe-bb6e-486d-b61c-7f237f0209ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:23.042615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f2afe-bb6e-486d-b61c-7f237f0209ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:23.052237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f2afe-bb6e-486d-b61c-7f237f0209ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:23.053689 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f2afe-bb6e-486d-b61c-7f237f0209ff service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:23.063021 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1395/2807] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:35:23.337670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcf0d5-94ad-409d-9948-f37034b447fa None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:35:23.339104 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-3dfcf0d5-94ad-409d-9948-f37034b447fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:35:23.351888 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcf0d5-94ad-409d-9948-f37034b447fa None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:35:23.356611 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:35:23.357438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:35:23.357727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:35:23.358005 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] PATH_INFO: `/v3/projects/ef4ceb15d93941319b1dbf5275a55196` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:35:23.359131 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4ceb15d93941319b1dbf5275a55196)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:35:23.361202 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:35:23.409044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4ceb15d93941319b1dbf5275a55196', 'request_id': 'req-db0bd86e-4e34-4046-a513-591c07bcfa26'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:23.415302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4ceb15d93941319b1dbf5275a55196', 'request_id': 'req-db0bd86e-4e34-4046-a513-591c07bcfa26'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:23.420815 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4ceb15d93941319b1dbf5275a55196', 'request_id': 'req-db0bd86e-4e34-4046-a513-591c07bcfa26'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:23.434656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] The token cache is being invalidate because project ef4ceb15d93941319b1dbf5275a55196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:35:23.434947 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:23.435577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:35:23.437038 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1413/2808] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:35:23 2022] DELETE /identity/v3/projects/ef4ceb15d93941319b1dbf5275a55196 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:35:33.058885 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:35:33.431704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:36:31.811709 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f2afe-bb6e-486d-b61c-7f237f0209ff service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:31.813123 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-879f2afe-bb6e-486d-b61c-7f237f0209ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:31.868793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f2afe-bb6e-486d-b61c-7f237f0209ff service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:31.917220 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:31.917890 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:31.918174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:31.918450 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:31.920200 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:31.989483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:31.990865 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:32.002363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1396/2809] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:36:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:36:33.713745 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:33.715208 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:33.773617 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bd86e-4e34-4046-a513-591c07bcfa26 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:33.777195 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600d80-0ebd-4ad7-ae9e-66112f92bef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:33.777849 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600d80-0ebd-4ad7-ae9e-66112f92bef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:33.778132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600d80-0ebd-4ad7-ae9e-66112f92bef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:33.778406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600d80-0ebd-4ad7-ae9e-66112f92bef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:33.780142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-a7600d80-0ebd-4ad7-ae9e-66112f92bef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:33.841082 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7600d80-0ebd-4ad7-ae9e-66112f92bef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:33.842543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7600d80-0ebd-4ad7-ae9e-66112f92bef2 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:33.851526 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1414/2810] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:36:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:36:34.927018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:34.929197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:34.942595 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6410443-a626-41bd-a75b-bb90b8a6b0ab service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:34.947190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46690cb-1085-449e-9971-7423c5f61717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:34.947443 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46690cb-1085-449e-9971-7423c5f61717 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:34.947732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46690cb-1085-449e-9971-7423c5f61717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:34.948007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46690cb-1085-449e-9971-7423c5f61717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:34.950778 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d46690cb-1085-449e-9971-7423c5f61717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:34.962287 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46690cb-1085-449e-9971-7423c5f61717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:34.963723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46690cb-1085-449e-9971-7423c5f61717 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:34.972353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1397/2811] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:36:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 18:36:35.883230 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600d80-0ebd-4ad7-ae9e-66112f92bef2 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:35.891904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600d80-0ebd-4ad7-ae9e-66112f92bef2 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:35.895507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:35.896097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:35.896375 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:35.896700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:35.898879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:35.911974 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:35.914041 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:35.924752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1415/2812] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:36:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:36:38.637607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46690cb-1085-449e-9971-7423c5f61717 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:38.646695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46690cb-1085-449e-9971-7423c5f61717 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:38.651127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:38.651985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:38.652388 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:38.652929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:38.654879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:38.698516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:36:38.718916 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:38.720369 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:38.730543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1398/2813] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:36:42.445091 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:42.446560 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:42.521810 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b95c-d403-4449-85a4-60e89ae4eab0 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:42.527340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6608d4f-101b-4d8e-b563-2834e5de5f57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:42.528099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6608d4f-101b-4d8e-b563-2834e5de5f57 service placement] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:42.528386 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6608d4f-101b-4d8e-b563-2834e5de5f57 service placement] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:42.528664 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6608d4f-101b-4d8e-b563-2834e5de5f57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:42.530433 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b6608d4f-101b-4d8e-b563-2834e5de5f57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:42.543754 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6608d4f-101b-4d8e-b563-2834e5de5f57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:42.545403 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6608d4f-101b-4d8e-b563-2834e5de5f57 service placement] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:42.556409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1416/2814] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:36:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:36:45.484669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:45.486820 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:45.501664 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfb460-171d-414f-9279-b577cb40a490 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:45.506469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:45.507231 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:45.507540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:45.507841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] PATH_INFO: `/v3/users/05b1d04112a04086a3766453e40bc922` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:45.508978 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b1d04112a04086a3766453e40bc922)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:45.510915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:45.561585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b1d04112a04086a3766453e40bc922'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.568638 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b1d04112a04086a3766453e40bc922'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.569304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b1d04112a04086a3766453e40bc922'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.582563 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b1d04112a04086a3766453e40bc922'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.589873 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b1d04112a04086a3766453e40bc922'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.595635 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1399/2815] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:36:45 2022] DELETE /identity/v3/users/05b1d04112a04086a3766453e40bc922 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:36:45.766265 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6608d4f-101b-4d8e-b563-2834e5de5f57 service placement] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:45.781860 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6608d4f-101b-4d8e-b563-2834e5de5f57 service placement] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:45.821943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=100 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:36:45.852064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:45.852700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:45.852982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:45.853398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] PATH_INFO: `/v3/projects/a2c397452fff40b4b1c89baf4fa095b4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:45.854618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c397452fff40b4b1c89baf4fa095b4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:45.856563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:45.905335 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c397452fff40b4b1c89baf4fa095b4', 'request_id': 'req-8ef681e3-47ad-4538-8f54-ff5a52858963'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.914059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c397452fff40b4b1c89baf4fa095b4', 'request_id': 'req-8ef681e3-47ad-4538-8f54-ff5a52858963'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.920426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c397452fff40b4b1c89baf4fa095b4', 'request_id': 'req-8ef681e3-47ad-4538-8f54-ff5a52858963'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.937599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] The token cache is being invalidate because project a2c397452fff40b4b1c89baf4fa095b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:36:45.937897 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.938529 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:45.940019 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1417/2816] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:36:45 2022] DELETE /identity/v3/projects/a2c397452fff40b4b1c89baf4fa095b4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:36:45.943986 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:45.945503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:45.958587 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbcc99-ed06-4514-b76f-69594888fb64 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:46.021618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:46.022633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:46.023188 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:46.023492 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] PATH_INFO: `/v3/users/fad72ce83d704597afca759711f12f77` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:46.024715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad72ce83d704597afca759711f12f77)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:46.026897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:46.076456 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad72ce83d704597afca759711f12f77'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.080378 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:36:46.084929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad72ce83d704597afca759711f12f77'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.094056 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad72ce83d704597afca759711f12f77'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.111110 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad72ce83d704597afca759711f12f77'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.119333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad72ce83d704597afca759711f12f77'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.126014 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1400/2817] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:36:45 2022] DELETE /identity/v3/users/fad72ce83d704597afca759711f12f77 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:36:46.556364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:36:46.557992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:36:46.578941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef681e3-47ad-4538-8f54-ff5a52858963 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:36:46.640669 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:36:46.641221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:36:46.641527 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:36:46.641855 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] PATH_INFO: `/v3/projects/956959a269654e6d949bd10891337640` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:36:46.643084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956959a269654e6d949bd10891337640)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:36:46.645022 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:36:46.698247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956959a269654e6d949bd10891337640', 'request_id': 'req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.704811 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956959a269654e6d949bd10891337640', 'request_id': 'req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.710736 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956959a269654e6d949bd10891337640', 'request_id': 'req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.712395 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:36:46.724659 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] The token cache is being invalidate because project 956959a269654e6d949bd10891337640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:36:46.724948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.726124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-f9e4cc4b-aea9-4d70-aaca-5d17cc732750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:36:46.727599 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1418/2818] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:36:46 2022] DELETE /identity/v3/projects/956959a269654e6d949bd10891337640 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:36:56.122296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:36:56.723667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:39:09.519762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:39:09.521669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:09.612382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d15003-00fb-4a62-bac1-8cbd2a47bca4 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:39:09.706315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:39:09.707128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:39:09.707569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:39:09.707913 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:39:09.709900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:09.724313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:39:09.726074 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:39:09.749577 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1401/2819] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:39:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:39:13.040895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e91a4-eebc-4370-adcb-181c433b9c00 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:39:13.041464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e91a4-eebc-4370-adcb-181c433b9c00 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:39:13.041464 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e91a4-eebc-4370-adcb-181c433b9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:39:13.059934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-b03e91a4-eebc-4370-adcb-181c433b9c00 None None] MFA Rules not processed for user `8e490c8ed3a04345896bc5e7a3360540`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:39:13.061114 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b03e91a4-eebc-4370-adcb-181c433b9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:13.114680 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1419/2820] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:39:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:39:13.420234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:39:13.422119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:13.478328 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ae4ee-e462-4b25-a935-5f30cae122b5 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:39:13.481892 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:39:13.482502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:39:13.482787 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:39:13.483066 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:39:13.484770 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:13.494597 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:39:13.496024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:39:13.503981 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1402/2821] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:39:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:39:13.826271 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e91a4-eebc-4370-adcb-181c433b9c00 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:39:13.827666 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b03e91a4-eebc-4370-adcb-181c433b9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:13.898524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e91a4-eebc-4370-adcb-181c433b9c00 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:39:13.903523 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b2964-842c-4836-9bc8-46561b5dfc51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:39:13.904130 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b2964-842c-4836-9bc8-46561b5dfc51 service placement] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:39:13.904410 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b2964-842c-4836-9bc8-46561b5dfc51 service placement] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:39:13.904682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b2964-842c-4836-9bc8-46561b5dfc51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:39:13.906394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-c43b2964-842c-4836-9bc8-46561b5dfc51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:13.917774 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b2964-842c-4836-9bc8-46561b5dfc51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:39:13.919351 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b2964-842c-4836-9bc8-46561b5dfc51 service placement] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:39:13.929196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1420/2822] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:39:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:39:22.490104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:39:22.492116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:22.509782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b8e05-6209-4359-af1c-f78183ee0618 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:39:22.515236 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491b2b-a9d3-4449-83df-97c06c779dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:39:22.515841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491b2b-a9d3-4449-83df-97c06c779dd0 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:39:22.516118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491b2b-a9d3-4449-83df-97c06c779dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:39:22.516391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491b2b-a9d3-4449-83df-97c06c779dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:39:22.518127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c3491b2b-a9d3-4449-83df-97c06c779dd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:22.530279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3491b2b-a9d3-4449-83df-97c06c779dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:39:22.531843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3491b2b-a9d3-4449-83df-97c06c779dd0 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:39:22.542525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1403/2823] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:39:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:39:23.924950 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=57 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:39:32.538665 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=94 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:39:35.511872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b2964-842c-4836-9bc8-46561b5dfc51 service placement] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:39:35.522357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b2964-842c-4836-9bc8-46561b5dfc51 service placement] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:39:35.527345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:39:35.527934 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:39:35.528222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:39:35.528497 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:39:35.530217 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:39:35.541992 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:39:35.543553 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:39:35.553426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1421/2824] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:39:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:39:45.549207 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=6 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:31.313856 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491b2b-a9d3-4449-83df-97c06c779dd0 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:31.326649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491b2b-a9d3-4449-83df-97c06c779dd0 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:31.332064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd710bb85a200419aa071e119976115c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:31.332666 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:31.332955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:31.333253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:31.334972 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:31.345081 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:31.346731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:31.355491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1404/2825] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:40:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:40:41.351428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=6 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:51.749737 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:51.751185 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:51.763369 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95856fa-638b-489b-8c63-45ae123afc70 service placement] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:51.766909 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:51.767507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:51.767789 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:51.768062 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:51.769757 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:51.831874 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:51.833345 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:51.842809 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1422/2826] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:40:54.892857 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:54.894392 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:54.910039 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71384ab-7a10-44a8-b906-e73f29e8aef1 service nova] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:54.915000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edb2d9-6e44-4b45-83bc-a4c5bcfa40e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:54.915610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edb2d9-6e44-4b45-83bc-a4c5bcfa40e8 service placement] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:54.916113 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edb2d9-6e44-4b45-83bc-a4c5bcfa40e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:54.916391 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edb2d9-6e44-4b45-83bc-a4c5bcfa40e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:54.918174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-63edb2d9-6e44-4b45-83bc-a4c5bcfa40e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:54.932060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edb2d9-6e44-4b45-83bc-a4c5bcfa40e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:54.933768 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edb2d9-6e44-4b45-83bc-a4c5bcfa40e8 service placement] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:54.946611 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1405/2827] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:40:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:40:54.950064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:54.951813 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:54.967340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3151c-a24b-4bb3-9064-91af93648dd6 service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:54.976621 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:54.977522 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:54.978051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:54.978371 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] PATH_INFO: `/v3/users/8e490c8ed3a04345896bc5e7a3360540` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:54.979734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e490c8ed3a04345896bc5e7a3360540)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:54.982024 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:55.033913 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e490c8ed3a04345896bc5e7a3360540'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.041222 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e490c8ed3a04345896bc5e7a3360540'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.041861 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e490c8ed3a04345896bc5e7a3360540'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.053776 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e490c8ed3a04345896bc5e7a3360540'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.060824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b5cc628b-503c-4807-984e-7ca03cc44e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e490c8ed3a04345896bc5e7a3360540'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.066991 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1423/2828] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:40:54 2022] DELETE /identity/v3/users/8e490c8ed3a04345896bc5e7a3360540 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:40:55.239747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edb2d9-6e44-4b45-83bc-a4c5bcfa40e8 service placement] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:55.251280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edb2d9-6e44-4b45-83bc-a4c5bcfa40e8 service placement] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:55.308357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:55.309851 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.310132 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.310403 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] PATH_INFO: `/v3/projects/9b387454b34b4ee8ab618d128949c34e` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.311502 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b387454b34b4ee8ab618d128949c34e)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:55.313419 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:55.359866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b387454b34b4ee8ab618d128949c34e', 'request_id': 'req-90a4effe-991a-4e65-a426-4f5c0b85f2a2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.366944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b387454b34b4ee8ab618d128949c34e', 'request_id': 'req-90a4effe-991a-4e65-a426-4f5c0b85f2a2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.373020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b387454b34b4ee8ab618d128949c34e', 'request_id': 'req-90a4effe-991a-4e65-a426-4f5c0b85f2a2'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.383798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] The token cache is being invalidate because project 9b387454b34b4ee8ab618d128949c34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:40:55.384083 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.384705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-90a4effe-991a-4e65-a426-4f5c0b85f2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:55.386425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1406/2829] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:40:55 2022] DELETE /identity/v3/projects/9b387454b34b4ee8ab618d128949c34e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:55.392097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b91eb-9c2c-4d40-877a-1ee4ac594adb None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.392389 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b91eb-9c2c-4d40-877a-1ee4ac594adb None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.392671 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b91eb-9c2c-4d40-877a-1ee4ac594adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.412138 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-7b7b91eb-9c2c-4d40-877a-1ee4ac594adb None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:40:55.413376 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7b7b91eb-9c2c-4d40-877a-1ee4ac594adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:55.471326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1424/2830] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:40:55.479512 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878620f-8c6d-4fa9-8b71-1ea3540e0726 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.479800 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878620f-8c6d-4fa9-8b71-1ea3540e0726 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.480103 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878620f-8c6d-4fa9-8b71-1ea3540e0726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.499852 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-e878620f-8c6d-4fa9-8b71-1ea3540e0726 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:40:55.500965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-e878620f-8c6d-4fa9-8b71-1ea3540e0726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:55.508646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1407/2831] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:40:55.513717 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b91eb-9c2c-4d40-877a-1ee4ac594adb None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:55.523274 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b91eb-9c2c-4d40-877a-1ee4ac594adb None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:55.527773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd869dd8-e34d-4223-9c19-e1de0860c80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:55.528359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869dd8-e34d-4223-9c19-e1de0860c80f admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.528636 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869dd8-e34d-4223-9c19-e1de0860c80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.528914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869dd8-e34d-4223-9c19-e1de0860c80f admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.529597 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd869dd8-e34d-4223-9c19-e1de0860c80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:40:55.529884 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd869dd8-e34d-4223-9c19-e1de0860c80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:55.531470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd869dd8-e34d-4223-9c19-e1de0860c80f admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:55.532885 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:55.545682 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1425/2832] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:40:55.549878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878620f-8c6d-4fa9-8b71-1ea3540e0726 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:55.559589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878620f-8c6d-4fa9-8b71-1ea3540e0726 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:55.564205 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa544507-2fe5-4d7a-8f99-a63915de88e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:55.564809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa544507-2fe5-4d7a-8f99-a63915de88e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.565089 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa544507-2fe5-4d7a-8f99-a63915de88e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.565398 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa544507-2fe5-4d7a-8f99-a63915de88e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.566027 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa544507-2fe5-4d7a-8f99-a63915de88e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:55.567914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa544507-2fe5-4d7a-8f99-a63915de88e2 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:55.603706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1408/2833] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:40:55 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:40:55.608438 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd869dd8-e34d-4223-9c19-e1de0860c80f admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:55.618434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd869dd8-e34d-4223-9c19-e1de0860c80f admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:55.673901 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a25ee0-95d7-4afe-83df-282204e934ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:55.674509 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a25ee0-95d7-4afe-83df-282204e934ed admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.674793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a25ee0-95d7-4afe-83df-282204e934ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.675063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a25ee0-95d7-4afe-83df-282204e934ed admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.675695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a25ee0-95d7-4afe-83df-282204e934ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:55.677631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a25ee0-95d7-4afe-83df-282204e934ed admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:55.699032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1426/2834] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:40:55 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:40:55.703149 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa544507-2fe5-4d7a-8f99-a63915de88e2 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:55.713442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa544507-2fe5-4d7a-8f99-a63915de88e2 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:55.718130 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f371b4-580c-4fd0-b831-e7a6014f6726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:55.718731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f371b4-580c-4fd0-b831-e7a6014f6726 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.719009 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f371b4-580c-4fd0-b831-e7a6014f6726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.719278 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f371b4-580c-4fd0-b831-e7a6014f6726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.719911 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f371b4-580c-4fd0-b831-e7a6014f6726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:55.721544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f371b4-580c-4fd0-b831-e7a6014f6726 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:55.731777 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1409/2835] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:40:55.735366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a25ee0-95d7-4afe-83df-282204e934ed admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:55.744905 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a25ee0-95d7-4afe-83df-282204e934ed admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:55.750196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310db4b2-9559-450e-82f4-a7a9e8e80c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:55.750722 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310db4b2-9559-450e-82f4-a7a9e8e80c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.751000 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310db4b2-9559-450e-82f4-a7a9e8e80c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.751272 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310db4b2-9559-450e-82f4-a7a9e8e80c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.751902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310db4b2-9559-450e-82f4-a7a9e8e80c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:55.753476 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310db4b2-9559-450e-82f4-a7a9e8e80c2e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:55.765067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1427/2836] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:40:55.768960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f371b4-580c-4fd0-b831-e7a6014f6726 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:55.778663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f371b4-580c-4fd0-b831-e7a6014f6726 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:55.783147 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdeb73-a2b8-45c6-af06-33474e766d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:55.783782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdeb73-a2b8-45c6-af06-33474e766d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.784060 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdeb73-a2b8-45c6-af06-33474e766d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.784332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdeb73-a2b8-45c6-af06-33474e766d42 admin admin] PATH_INFO: `/v3/projects/533c0ef7d42b4ebb8e7435ae87bfe44f/users/1c7ccb21c6464cc6bc9f145a7228c8fa/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.799037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdeb73-a2b8-45c6-af06-33474e766d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533c0ef7d42b4ebb8e7435ae87bfe44f, user_id=1c7ccb21c6464cc6bc9f145a7228c8fa, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:55.801662 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdeb73-a2b8-45c6-af06-33474e766d42 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:55.813791 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1410/2837] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:40:55 2022] PUT /identity/v3/projects/533c0ef7d42b4ebb8e7435ae87bfe44f/users/1c7ccb21c6464cc6bc9f145a7228c8fa/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:55.825537 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a5fed-3d75-4096-ae5d-4017f23517e6 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.826099 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a5fed-3d75-4096-ae5d-4017f23517e6 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.826602 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a5fed-3d75-4096-ae5d-4017f23517e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.855827 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-747a5fed-3d75-4096-ae5d-4017f23517e6 None None] MFA Rules not processed for user `1c7ccb21c6464cc6bc9f145a7228c8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:40:55.857026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-747a5fed-3d75-4096-ae5d-4017f23517e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:55.924775 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1428/2838] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:40:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:40:55.929491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdeb73-a2b8-45c6-af06-33474e766d42 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:55.935740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:55.992179 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdeb73-a2b8-45c6-af06-33474e766d42 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:55.997439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2635a-d8eb-4415-ab88-528ae850f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:55.998048 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2635a-d8eb-4415-ab88-528ae850f461 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:55.998335 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2635a-d8eb-4415-ab88-528ae850f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:55.998617 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2635a-d8eb-4415-ab88-528ae850f461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:55.999246 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2635a-d8eb-4415-ab88-528ae850f461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:56.001183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2635a-d8eb-4415-ab88-528ae850f461 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:56.027752 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1411/2839] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:40:55 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:40:56.031823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a5fed-3d75-4096-ae5d-4017f23517e6 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:56.042304 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a5fed-3d75-4096-ae5d-4017f23517e6 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:56.096693 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eed2af-9c46-436a-a42e-01d703076a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:56.097323 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eed2af-9c46-436a-a42e-01d703076a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:56.097604 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eed2af-9c46-436a-a42e-01d703076a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:56.097875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eed2af-9c46-436a-a42e-01d703076a97 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:56.098498 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eed2af-9c46-436a-a42e-01d703076a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:56.100383 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eed2af-9c46-436a-a42e-01d703076a97 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:56.109709 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:56.121729 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1429/2840] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:40:56 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:40:56.125803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2635a-d8eb-4415-ab88-528ae850f461 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:56.136276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2635a-d8eb-4415-ab88-528ae850f461 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:56.140861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6abdee-9c56-4cea-a9a5-b8577cc40cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:56.141500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6abdee-9c56-4cea-a9a5-b8577cc40cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:56.141784 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6abdee-9c56-4cea-a9a5-b8577cc40cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:56.142064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6abdee-9c56-4cea-a9a5-b8577cc40cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:56.142706 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6abdee-9c56-4cea-a9a5-b8577cc40cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:56.144319 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6abdee-9c56-4cea-a9a5-b8577cc40cd0 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:56.155547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1412/2841] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:40:56.159447 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eed2af-9c46-436a-a42e-01d703076a97 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:56.169800 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eed2af-9c46-436a-a42e-01d703076a97 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:56.174370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eeb00-e6e3-4030-87c3-c2cd3079b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:56.175007 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eeb00-e6e3-4030-87c3-c2cd3079b323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:56.175287 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eeb00-e6e3-4030-87c3-c2cd3079b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:56.175558 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eeb00-e6e3-4030-87c3-c2cd3079b323 admin admin] PATH_INFO: `/v3/projects/e76629e6e3ea428fab507dff6e17749f/users/85c330feb01146cfa3bb8ddb02bfa205/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:56.190550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eeb00-e6e3-4030-87c3-c2cd3079b323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76629e6e3ea428fab507dff6e17749f, user_id=85c330feb01146cfa3bb8ddb02bfa205, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:56.193459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eeb00-e6e3-4030-87c3-c2cd3079b323 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:56.211902 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1430/2842] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:40:56 2022] PUT /identity/v3/projects/e76629e6e3ea428fab507dff6e17749f/users/85c330feb01146cfa3bb8ddb02bfa205/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:56.218101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6abdee-9c56-4cea-a9a5-b8577cc40cd0 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:56.232584 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6abdee-9c56-4cea-a9a5-b8577cc40cd0 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:56.289135 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22968a-2f74-48f2-9ab3-eae9996f45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:56.289703 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22968a-2f74-48f2-9ab3-eae9996f45ef admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:56.289989 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22968a-2f74-48f2-9ab3-eae9996f45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:56.290267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22968a-2f74-48f2-9ab3-eae9996f45ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:56.290902 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22968a-2f74-48f2-9ab3-eae9996f45ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:56.292486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22968a-2f74-48f2-9ab3-eae9996f45ef admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:56.302696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1413/2843] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:40:56.306848 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eeb00-e6e3-4030-87c3-c2cd3079b323 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:56.317601 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eeb00-e6e3-4030-87c3-c2cd3079b323 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:56.322108 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5f990-281f-432e-966b-b88aeb02222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:56.322747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5f990-281f-432e-966b-b88aeb02222d admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:56.323027 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5f990-281f-432e-966b-b88aeb02222d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:56.323299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5f990-281f-432e-966b-b88aeb02222d admin admin] PATH_INFO: `/v3/projects/e76629e6e3ea428fab507dff6e17749f/users/85c330feb01146cfa3bb8ddb02bfa205/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:56.325766 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5f990-281f-432e-966b-b88aeb02222d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76629e6e3ea428fab507dff6e17749f, user_id=85c330feb01146cfa3bb8ddb02bfa205, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:56.328378 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5f990-281f-432e-966b-b88aeb02222d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:56.338232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1431/2844] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:40:56 2022] PUT /identity/v3/projects/e76629e6e3ea428fab507dff6e17749f/users/85c330feb01146cfa3bb8ddb02bfa205/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:56.348980 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4287140-c78f-4d35-9362-9a2bb7bad66b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:56.349301 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4287140-c78f-4d35-9362-9a2bb7bad66b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:56.349583 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4287140-c78f-4d35-9362-9a2bb7bad66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:56.377627 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-c4287140-c78f-4d35-9362-9a2bb7bad66b None None] MFA Rules not processed for user `85c330feb01146cfa3bb8ddb02bfa205`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:40:56.378926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c4287140-c78f-4d35-9362-9a2bb7bad66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:56.451445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:56.464433 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1414/2845] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:40:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:40:56.470297 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5f990-281f-432e-966b-b88aeb02222d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:56.472058 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-daa5f990-281f-432e-966b-b88aeb02222d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:56.555791 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5f990-281f-432e-966b-b88aeb02222d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:56.559550 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf609c0-3880-4447-b355-e30799e5eb94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:56.560350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf609c0-3880-4447-b355-e30799e5eb94 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:56.560640 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf609c0-3880-4447-b355-e30799e5eb94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:56.560916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf609c0-3880-4447-b355-e30799e5eb94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:56.570898 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf609c0-3880-4447-b355-e30799e5eb94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:56.572343 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf609c0-3880-4447-b355-e30799e5eb94 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:56.582778 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1432/2846] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:40:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:40:57.159156 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4287140-c78f-4d35-9362-9a2bb7bad66b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:57.218866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4287140-c78f-4d35-9362-9a2bb7bad66b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:57.223303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:57.223922 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:57.224201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:57.224474 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] PATH_INFO: `/v3/users/1c7ccb21c6464cc6bc9f145a7228c8fa` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:57.225596 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7ccb21c6464cc6bc9f145a7228c8fa)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:57.227481 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:57.272983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7ccb21c6464cc6bc9f145a7228c8fa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.280376 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7ccb21c6464cc6bc9f145a7228c8fa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.281002 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7ccb21c6464cc6bc9f145a7228c8fa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.292845 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7ccb21c6464cc6bc9f145a7228c8fa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.300337 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7ccb21c6464cc6bc9f145a7228c8fa'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.306312 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1415/2847] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:40:57 2022] DELETE /identity/v3/users/1c7ccb21c6464cc6bc9f145a7228c8fa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:57.311472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7a3bf-ad36-4c5f-9249-96a766dbf52f None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:57.311955 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7a3bf-ad36-4c5f-9249-96a766dbf52f None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:57.312057 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7a3bf-ad36-4c5f-9249-96a766dbf52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:57.330538 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8fa7a3bf-ad36-4c5f-9249-96a766dbf52f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:40:57.331670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8fa7a3bf-ad36-4c5f-9249-96a766dbf52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:57.389716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1433/2848] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:40:57.399439 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:57.400868 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:57.457798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3db1e-335f-4601-a64a-fc95932c0005 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:57.461488 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964333-f97a-4c55-af52-fc155ba5a822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:57.462095 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964333-f97a-4c55-af52-fc155ba5a822 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:57.462380 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964333-f97a-4c55-af52-fc155ba5a822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:57.462656 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01964333-f97a-4c55-af52-fc155ba5a822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:57.472047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01964333-f97a-4c55-af52-fc155ba5a822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:57.473514 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01964333-f97a-4c55-af52-fc155ba5a822 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:57.483441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1416/2849] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:40:57.748994 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7a3bf-ad36-4c5f-9249-96a766dbf52f None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:57.750469 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8fa7a3bf-ad36-4c5f-9249-96a766dbf52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:57.762698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7a3bf-ad36-4c5f-9249-96a766dbf52f None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:57.767752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:57.768391 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:57.768677 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:57.768953 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] PATH_INFO: `/v3/projects/533c0ef7d42b4ebb8e7435ae87bfe44f` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:57.770115 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533c0ef7d42b4ebb8e7435ae87bfe44f)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:57.772056 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:57.819065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533c0ef7d42b4ebb8e7435ae87bfe44f', 'request_id': 'req-000eae56-ab51-48fd-a777-360ce1577e28'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.820895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:57.826357 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533c0ef7d42b4ebb8e7435ae87bfe44f', 'request_id': 'req-000eae56-ab51-48fd-a777-360ce1577e28'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.832819 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533c0ef7d42b4ebb8e7435ae87bfe44f', 'request_id': 'req-000eae56-ab51-48fd-a777-360ce1577e28'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.845618 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] The token cache is being invalidate because project 533c0ef7d42b4ebb8e7435ae87bfe44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:40:57.845923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.846563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.849716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1434/2850] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:40:57 2022] DELETE /identity/v3/projects/533c0ef7d42b4ebb8e7435ae87bfe44f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:57.853893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964333-f97a-4c55-af52-fc155ba5a822 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:57.864461 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01964333-f97a-4c55-af52-fc155ba5a822 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:57.886318 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:57.929544 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:57.930174 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:57.930455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:57.930731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] PATH_INFO: `/v3/users/85c330feb01146cfa3bb8ddb02bfa205` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:57.931849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c330feb01146cfa3bb8ddb02bfa205)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:57.933793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:57.980299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c330feb01146cfa3bb8ddb02bfa205'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.987794 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c330feb01146cfa3bb8ddb02bfa205'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:57.988418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c330feb01146cfa3bb8ddb02bfa205'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:58.000347 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c330feb01146cfa3bb8ddb02bfa205'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:58.007250 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-edbec1ad-626f-4bab-9483-a26c7aa0a2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c330feb01146cfa3bb8ddb02bfa205'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:58.014128 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1417/2851] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:40:57 2022] DELETE /identity/v3/users/85c330feb01146cfa3bb8ddb02bfa205 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:58.296744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:58.298273 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:58.311998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eae56-ab51-48fd-a777-360ce1577e28 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:58.369293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:58.369941 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.370228 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.370507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] PATH_INFO: `/v3/projects/e76629e6e3ea428fab507dff6e17749f` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.372135 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76629e6e3ea428fab507dff6e17749f)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:58.374081 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:58.419625 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76629e6e3ea428fab507dff6e17749f', 'request_id': 'req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:58.425607 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76629e6e3ea428fab507dff6e17749f', 'request_id': 'req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:58.431239 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76629e6e3ea428fab507dff6e17749f', 'request_id': 'req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:58.444442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] The token cache is being invalidate because project e76629e6e3ea428fab507dff6e17749f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:40:58.444734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:58.445399 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-abfef491-45d2-48f1-ab48-fadeb7bf1cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:40:58.446863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1435/2852] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:40:58 2022] DELETE /identity/v3/projects/e76629e6e3ea428fab507dff6e17749f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:58.452600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1a362-0bb7-4728-ac9b-f7dfc3032b7b None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.453091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1a362-0bb7-4728-ac9b-f7dfc3032b7b None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.453206 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1a362-0bb7-4728-ac9b-f7dfc3032b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.472696 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-66a1a362-0bb7-4728-ac9b-f7dfc3032b7b None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:40:58.474064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-66a1a362-0bb7-4728-ac9b-f7dfc3032b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:58.537580 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1418/2853] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:40:58.546002 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103f90a-4daa-4c1e-8c8a-f14cb3937a4a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.546293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103f90a-4daa-4c1e-8c8a-f14cb3937a4a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.546570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103f90a-4daa-4c1e-8c8a-f14cb3937a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.577703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-f103f90a-4daa-4c1e-8c8a-f14cb3937a4a None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:40:58.578933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f103f90a-4daa-4c1e-8c8a-f14cb3937a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:58.586930 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1436/2854] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:40:58.591420 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1a362-0bb7-4728-ac9b-f7dfc3032b7b None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:58.601283 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1a362-0bb7-4728-ac9b-f7dfc3032b7b None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:58.606547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4b042-664d-4357-8c5c-9b7b2d9e63b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:58.607153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b042-664d-4357-8c5c-9b7b2d9e63b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.607464 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b042-664d-4357-8c5c-9b7b2d9e63b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.607740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b042-664d-4357-8c5c-9b7b2d9e63b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.608382 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4b042-664d-4357-8c5c-9b7b2d9e63b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:40:58.608688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4b042-664d-4357-8c5c-9b7b2d9e63b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:58.610310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4b042-664d-4357-8c5c-9b7b2d9e63b3 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:58.622373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1419/2855] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:40:58.626610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103f90a-4daa-4c1e-8c8a-f14cb3937a4a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:58.636010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103f90a-4daa-4c1e-8c8a-f14cb3937a4a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:58.640658 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9152c-a785-44d8-a03f-ab0de19ffc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:58.641316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9152c-a785-44d8-a03f-ab0de19ffc34 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.641564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9152c-a785-44d8-a03f-ab0de19ffc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.641841 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9152c-a785-44d8-a03f-ab0de19ffc34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.642466 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9152c-a785-44d8-a03f-ab0de19ffc34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:58.644334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9152c-a785-44d8-a03f-ab0de19ffc34 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:58.671734 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1437/2856] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:40:58 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:40:58.675903 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4b042-664d-4357-8c5c-9b7b2d9e63b3 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:58.686831 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4b042-664d-4357-8c5c-9b7b2d9e63b3 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:58.713366 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:58.746841 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61081219-6cfa-4e11-a91c-ea63c9767afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:58.747453 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61081219-6cfa-4e11-a91c-ea63c9767afc admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.747734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61081219-6cfa-4e11-a91c-ea63c9767afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.748003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61081219-6cfa-4e11-a91c-ea63c9767afc admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.748630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61081219-6cfa-4e11-a91c-ea63c9767afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:58.750581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61081219-6cfa-4e11-a91c-ea63c9767afc admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:58.771307 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1420/2857] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:40:58 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:40:58.775561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9152c-a785-44d8-a03f-ab0de19ffc34 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:58.785894 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9152c-a785-44d8-a03f-ab0de19ffc34 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:58.790441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c8a4-218c-4223-8e0b-584aeab34f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:58.791326 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c8a4-218c-4223-8e0b-584aeab34f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.791613 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c8a4-218c-4223-8e0b-584aeab34f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.791890 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c8a4-218c-4223-8e0b-584aeab34f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.792533 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c8a4-218c-4223-8e0b-584aeab34f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:58.794655 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c8a4-218c-4223-8e0b-584aeab34f46 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:58.804859 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1438/2858] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:40:58.808555 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61081219-6cfa-4e11-a91c-ea63c9767afc admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:58.818918 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61081219-6cfa-4e11-a91c-ea63c9767afc admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:58.823486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73da85-55fb-4edc-b873-495b8f472809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:58.824077 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73da85-55fb-4edc-b873-495b8f472809 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.824360 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73da85-55fb-4edc-b873-495b8f472809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.824639 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73da85-55fb-4edc-b873-495b8f472809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.825306 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73da85-55fb-4edc-b873-495b8f472809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:58.826883 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73da85-55fb-4edc-b873-495b8f472809 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:58.837355 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1421/2859] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:40:58.841348 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c8a4-218c-4223-8e0b-584aeab34f46 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:58.855390 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c8a4-218c-4223-8e0b-584aeab34f46 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:58.860575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7ce9-ba43-4325-82da-434937b59588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:58.861262 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7ce9-ba43-4325-82da-434937b59588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.861559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7ce9-ba43-4325-82da-434937b59588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.861838 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d7ce9-ba43-4325-82da-434937b59588 admin admin] PATH_INFO: `/v3/projects/26680bea3bf34f4fbf240e2a8dc7ba51/users/a07f0d223a814fba839384d080b22434/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.877329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d7ce9-ba43-4325-82da-434937b59588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26680bea3bf34f4fbf240e2a8dc7ba51, user_id=a07f0d223a814fba839384d080b22434, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:58.879969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d7ce9-ba43-4325-82da-434937b59588 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:58.893303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1439/2860] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:40:58 2022] PUT /identity/v3/projects/26680bea3bf34f4fbf240e2a8dc7ba51/users/a07f0d223a814fba839384d080b22434/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:58.905117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32ab67-e79e-4646-8c7c-8cfe790ff3aa None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:58.905442 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32ab67-e79e-4646-8c7c-8cfe790ff3aa None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:58.905725 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32ab67-e79e-4646-8c7c-8cfe790ff3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:58.933320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-cf32ab67-e79e-4646-8c7c-8cfe790ff3aa None None] MFA Rules not processed for user `a07f0d223a814fba839384d080b22434`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:40:58.934477 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-cf32ab67-e79e-4646-8c7c-8cfe790ff3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:58.997815 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1422/2861] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:40:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:40:59.002293 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7ce9-ba43-4325-82da-434937b59588 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:59.011356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:59.065153 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d7ce9-ba43-4325-82da-434937b59588 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:59.069794 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282401f-cb7d-429c-ace2-98116b27ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:59.070425 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282401f-cb7d-429c-ace2-98116b27ce94 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:59.070707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282401f-cb7d-429c-ace2-98116b27ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:59.070980 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282401f-cb7d-429c-ace2-98116b27ce94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:59.071606 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282401f-cb7d-429c-ace2-98116b27ce94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:59.073559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282401f-cb7d-429c-ace2-98116b27ce94 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:59.099309 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1440/2862] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:40:59 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:40:59.103438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32ab67-e79e-4646-8c7c-8cfe790ff3aa None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:59.114431 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32ab67-e79e-4646-8c7c-8cfe790ff3aa None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:59.170821 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067835b-fbc6-4f80-8f20-61f8f21613d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:59.171435 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067835b-fbc6-4f80-8f20-61f8f21613d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:59.171723 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067835b-fbc6-4f80-8f20-61f8f21613d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:59.172005 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067835b-fbc6-4f80-8f20-61f8f21613d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:59.172649 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067835b-fbc6-4f80-8f20-61f8f21613d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:59.174593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067835b-fbc6-4f80-8f20-61f8f21613d9 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:59.195134 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1423/2863] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:40:59 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:40:59.199246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282401f-cb7d-429c-ace2-98116b27ce94 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:59.209431 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282401f-cb7d-429c-ace2-98116b27ce94 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:59.213956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14540-b07b-4f72-97a0-d8c229305efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:59.214556 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14540-b07b-4f72-97a0-d8c229305efb admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:59.215330 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14540-b07b-4f72-97a0-d8c229305efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:59.215626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14540-b07b-4f72-97a0-d8c229305efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:59.216283 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c14540-b07b-4f72-97a0-d8c229305efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:59.217961 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c14540-b07b-4f72-97a0-d8c229305efb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:59.228307 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1441/2864] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:40:59.233628 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067835b-fbc6-4f80-8f20-61f8f21613d9 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:59.246486 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067835b-fbc6-4f80-8f20-61f8f21613d9 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:59.251349 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f7d7e-3ba1-4843-b310-3eab5b7c7cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:59.252018 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7d7e-3ba1-4843-b310-3eab5b7c7cef admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:59.252303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7d7e-3ba1-4843-b310-3eab5b7c7cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:59.252581 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7d7e-3ba1-4843-b310-3eab5b7c7cef admin admin] PATH_INFO: `/v3/projects/e36395bf9f7546cf90f2e1378ceefeb7/users/9991e61cd893407aa97ae3113afb56b1/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:59.267931 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f7d7e-3ba1-4843-b310-3eab5b7c7cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36395bf9f7546cf90f2e1378ceefeb7, user_id=9991e61cd893407aa97ae3113afb56b1, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:59.270660 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f7d7e-3ba1-4843-b310-3eab5b7c7cef admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:59.284571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1424/2865] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:40:59 2022] PUT /identity/v3/projects/e36395bf9f7546cf90f2e1378ceefeb7/users/9991e61cd893407aa97ae3113afb56b1/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:40:59.288480 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14540-b07b-4f72-97a0-d8c229305efb admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:59.299077 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14540-b07b-4f72-97a0-d8c229305efb admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:59.354566 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c9975-efd8-425f-9d2a-11d1e2de81dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:59.355232 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c9975-efd8-425f-9d2a-11d1e2de81dc admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:59.355442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c9975-efd8-425f-9d2a-11d1e2de81dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:59.355721 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c9975-efd8-425f-9d2a-11d1e2de81dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:59.356358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c9975-efd8-425f-9d2a-11d1e2de81dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:59.357986 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c9975-efd8-425f-9d2a-11d1e2de81dc admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:59.367432 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1442/2866] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:40:59.371734 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f7d7e-3ba1-4843-b310-3eab5b7c7cef admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:59.377207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:40:59.383615 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f7d7e-3ba1-4843-b310-3eab5b7c7cef admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:59.389333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9086c-6a3a-4113-966d-6a29d15ba39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:59.389990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9086c-6a3a-4113-966d-6a29d15ba39e admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:59.390276 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9086c-6a3a-4113-966d-6a29d15ba39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:59.390554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9086c-6a3a-4113-966d-6a29d15ba39e admin admin] PATH_INFO: `/v3/projects/e36395bf9f7546cf90f2e1378ceefeb7/users/9991e61cd893407aa97ae3113afb56b1/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:59.392482 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9086c-6a3a-4113-966d-6a29d15ba39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36395bf9f7546cf90f2e1378ceefeb7, user_id=9991e61cd893407aa97ae3113afb56b1, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:59.395705 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9086c-6a3a-4113-966d-6a29d15ba39e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:59.408427 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1425/2867] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:40:59 2022] PUT /identity/v3/projects/e36395bf9f7546cf90f2e1378ceefeb7/users/9991e61cd893407aa97ae3113afb56b1/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:40:59.419119 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e8b0-c83e-40d1-b580-51818fb2a984 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:59.419411 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e8b0-c83e-40d1-b580-51818fb2a984 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:59.419694 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e8b0-c83e-40d1-b580-51818fb2a984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:59.446917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-6cd9e8b0-c83e-40d1-b580-51818fb2a984 None None] MFA Rules not processed for user `9991e61cd893407aa97ae3113afb56b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:40:59.448060 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6cd9e8b0-c83e-40d1-b580-51818fb2a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:59.515725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1443/2868] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:40:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:40:59.526314 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9086c-6a3a-4113-966d-6a29d15ba39e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:59.528065 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b0a9086c-6a3a-4113-966d-6a29d15ba39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:40:59.584634 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9086c-6a3a-4113-966d-6a29d15ba39e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:40:59.588315 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5ac0-f4cf-4648-a76d-190f04a4824b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:40:59.588914 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5ac0-f4cf-4648-a76d-190f04a4824b service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:40:59.589195 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5ac0-f4cf-4648-a76d-190f04a4824b service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:40:59.589501 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5ac0-f4cf-4648-a76d-190f04a4824b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:40:59.598899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c5ac0-f4cf-4648-a76d-190f04a4824b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:40:59.600322 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c5ac0-f4cf-4648-a76d-190f04a4824b service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:40:59.609670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1426/2869] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:40:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:40:59.974711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e8b0-c83e-40d1-b580-51818fb2a984 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:40:59.978872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:00.038790 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e8b0-c83e-40d1-b580-51818fb2a984 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:00.043277 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:00.043899 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:00.044183 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:00.044453 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] PATH_INFO: `/v3/users/a07f0d223a814fba839384d080b22434` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:00.045582 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07f0d223a814fba839384d080b22434)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:00.047481 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:00.092971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07f0d223a814fba839384d080b22434'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.100284 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07f0d223a814fba839384d080b22434'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.100916 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07f0d223a814fba839384d080b22434'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.112837 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07f0d223a814fba839384d080b22434'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.119665 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07f0d223a814fba839384d080b22434'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.125494 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1444/2870] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:40:59 2022] DELETE /identity/v3/users/a07f0d223a814fba839384d080b22434 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:00.130302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea468e-ea89-4ad0-85c6-83e0138cba5c None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:00.130588 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea468e-ea89-4ad0-85c6-83e0138cba5c None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:00.130861 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea468e-ea89-4ad0-85c6-83e0138cba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:00.150803 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-eaea468e-ea89-4ad0-85c6-83e0138cba5c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:00.151985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-eaea468e-ea89-4ad0-85c6-83e0138cba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:00.210166 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1427/2871] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:41:00.220259 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:00.221744 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:00.281948 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242ba32-9cc8-4a55-b144-4ead3647ea73 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:00.285600 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c2fe5-c140-43f8-937e-0fcc847ffeec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:00.286216 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c2fe5-c140-43f8-937e-0fcc847ffeec service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:00.286501 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c2fe5-c140-43f8-937e-0fcc847ffeec service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:00.286782 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c2fe5-c140-43f8-937e-0fcc847ffeec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:00.295727 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c2fe5-c140-43f8-937e-0fcc847ffeec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:00.297155 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c2fe5-c140-43f8-937e-0fcc847ffeec service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:00.306546 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1445/2872] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:00.580686 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea468e-ea89-4ad0-85c6-83e0138cba5c None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:00.582184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-eaea468e-ea89-4ad0-85c6-83e0138cba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:00.597096 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea468e-ea89-4ad0-85c6-83e0138cba5c None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:00.601985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:00.602629 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:00.602908 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:00.603183 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] PATH_INFO: `/v3/projects/26680bea3bf34f4fbf240e2a8dc7ba51` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:00.604363 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26680bea3bf34f4fbf240e2a8dc7ba51)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:00.606338 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:00.653298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26680bea3bf34f4fbf240e2a8dc7ba51', 'request_id': 'req-b239c273-2068-484d-b9f9-54ee8dcc8508'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.662576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26680bea3bf34f4fbf240e2a8dc7ba51', 'request_id': 'req-b239c273-2068-484d-b9f9-54ee8dcc8508'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.668715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26680bea3bf34f4fbf240e2a8dc7ba51', 'request_id': 'req-b239c273-2068-484d-b9f9-54ee8dcc8508'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.680164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] The token cache is being invalidate because project 26680bea3bf34f4fbf240e2a8dc7ba51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:41:00.680463 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.681116 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.682619 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1428/2873] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:41:00 2022] DELETE /identity/v3/projects/26680bea3bf34f4fbf240e2a8dc7ba51 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:00.687251 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c2fe5-c140-43f8-937e-0fcc847ffeec service neutron] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:00.696847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c2fe5-c140-43f8-937e-0fcc847ffeec service neutron] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:00.716929 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:00.754570 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:00.755198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:00.755483 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:00.755761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] PATH_INFO: `/v3/users/9991e61cd893407aa97ae3113afb56b1` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:00.756879 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9991e61cd893407aa97ae3113afb56b1)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:00.758826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:00.806928 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9991e61cd893407aa97ae3113afb56b1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.814923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9991e61cd893407aa97ae3113afb56b1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.815561 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9991e61cd893407aa97ae3113afb56b1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.827465 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9991e61cd893407aa97ae3113afb56b1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.834286 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ae247f4-67c0-45ec-84fd-8a8b5bdf46a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9991e61cd893407aa97ae3113afb56b1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:00.840044 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1446/2874] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:41:00 2022] DELETE /identity/v3/users/9991e61cd893407aa97ae3113afb56b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:01.106528 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:01.108546 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:01.121680 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239c273-2068-484d-b9f9-54ee8dcc8508 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:01.134308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:01.181525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:01.182160 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.182441 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.182713 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] PATH_INFO: `/v3/projects/e36395bf9f7546cf90f2e1378ceefeb7` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.183809 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36395bf9f7546cf90f2e1378ceefeb7)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:01.186253 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:01.230930 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36395bf9f7546cf90f2e1378ceefeb7', 'request_id': 'req-79a6c4d9-bd62-4c32-844f-988f93a77c51'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:01.237764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36395bf9f7546cf90f2e1378ceefeb7', 'request_id': 'req-79a6c4d9-bd62-4c32-844f-988f93a77c51'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:01.243222 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36395bf9f7546cf90f2e1378ceefeb7', 'request_id': 'req-79a6c4d9-bd62-4c32-844f-988f93a77c51'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:01.254825 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] The token cache is being invalidate because project e36395bf9f7546cf90f2e1378ceefeb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:41:01.255118 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:01.255772 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-79a6c4d9-bd62-4c32-844f-988f93a77c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:01.257230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1429/2875] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:41:01 2022] DELETE /identity/v3/projects/e36395bf9f7546cf90f2e1378ceefeb7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:01.262366 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394259e-5a80-43be-bbfe-e6b531ae11d7 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.262662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394259e-5a80-43be-bbfe-e6b531ae11d7 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.262966 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394259e-5a80-43be-bbfe-e6b531ae11d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.282922 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-9394259e-5a80-43be-bbfe-e6b531ae11d7 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:01.284129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-9394259e-5a80-43be-bbfe-e6b531ae11d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:01.341824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1447/2876] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:01.350657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28aab9-a5b0-4725-96fc-0bff24de3c80 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.350948 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28aab9-a5b0-4725-96fc-0bff24de3c80 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.351226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28aab9-a5b0-4725-96fc-0bff24de3c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.370460 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-6b28aab9-a5b0-4725-96fc-0bff24de3c80 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:01.371663 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-6b28aab9-a5b0-4725-96fc-0bff24de3c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:01.380022 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1430/2877] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:41:01.384103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394259e-5a80-43be-bbfe-e6b531ae11d7 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:01.394743 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394259e-5a80-43be-bbfe-e6b531ae11d7 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:01.399327 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b5bf-cbda-4ea4-9bb1-0d93ba70d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:01.399933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b5bf-cbda-4ea4-9bb1-0d93ba70d054 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.400235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b5bf-cbda-4ea4-9bb1-0d93ba70d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.400505 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b5bf-cbda-4ea4-9bb1-0d93ba70d054 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.401145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b5bf-cbda-4ea4-9bb1-0d93ba70d054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:41:01.401475 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b5bf-cbda-4ea4-9bb1-0d93ba70d054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:01.403065 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b5bf-cbda-4ea4-9bb1-0d93ba70d054 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:01.414298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1448/2878] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:41:01.418758 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28aab9-a5b0-4725-96fc-0bff24de3c80 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:01.427904 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28aab9-a5b0-4725-96fc-0bff24de3c80 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:01.432491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64fb2-a27d-4fa5-8b87-9eedab7ff179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:01.433084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64fb2-a27d-4fa5-8b87-9eedab7ff179 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.433414 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64fb2-a27d-4fa5-8b87-9eedab7ff179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.433695 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64fb2-a27d-4fa5-8b87-9eedab7ff179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.434320 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb64fb2-a27d-4fa5-8b87-9eedab7ff179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:01.436704 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb64fb2-a27d-4fa5-8b87-9eedab7ff179 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:01.463776 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1431/2879] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:41:01 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:41:01.467784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b5bf-cbda-4ea4-9bb1-0d93ba70d054 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:01.478051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b5bf-cbda-4ea4-9bb1-0d93ba70d054 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:01.506303 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:01.535826 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccef45e-49f6-4755-9793-1d2fe16888cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:01.536423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccef45e-49f6-4755-9793-1d2fe16888cf admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.536703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccef45e-49f6-4755-9793-1d2fe16888cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.536978 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccef45e-49f6-4755-9793-1d2fe16888cf admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.537624 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccef45e-49f6-4755-9793-1d2fe16888cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:01.539514 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccef45e-49f6-4755-9793-1d2fe16888cf admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:01.561917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1449/2880] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:41:01 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:41:01.566432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64fb2-a27d-4fa5-8b87-9eedab7ff179 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:01.577127 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64fb2-a27d-4fa5-8b87-9eedab7ff179 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:01.581745 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b49f-d083-41bf-b154-67b1ca6a17fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:01.582340 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b49f-d083-41bf-b154-67b1ca6a17fc admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.582623 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b49f-d083-41bf-b154-67b1ca6a17fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.582901 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b49f-d083-41bf-b154-67b1ca6a17fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.583548 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b49f-d083-41bf-b154-67b1ca6a17fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:01.585143 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b49f-d083-41bf-b154-67b1ca6a17fc admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:01.594992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1432/2881] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:01.598751 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccef45e-49f6-4755-9793-1d2fe16888cf admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:01.609059 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccef45e-49f6-4755-9793-1d2fe16888cf admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:01.613651 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946ca5f-ee1a-4c10-a228-97b8b3c478bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:01.614243 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946ca5f-ee1a-4c10-a228-97b8b3c478bb admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.614528 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946ca5f-ee1a-4c10-a228-97b8b3c478bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.614807 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946ca5f-ee1a-4c10-a228-97b8b3c478bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.615442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946ca5f-ee1a-4c10-a228-97b8b3c478bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:01.617002 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946ca5f-ee1a-4c10-a228-97b8b3c478bb admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:01.627954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1450/2882] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:01.631837 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b49f-d083-41bf-b154-67b1ca6a17fc admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:01.641870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b49f-d083-41bf-b154-67b1ca6a17fc admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:01.646440 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736154-fcea-425c-84bf-ebb8e2402270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:01.647075 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736154-fcea-425c-84bf-ebb8e2402270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.647362 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736154-fcea-425c-84bf-ebb8e2402270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.647642 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736154-fcea-425c-84bf-ebb8e2402270 admin admin] PATH_INFO: `/v3/projects/bd6c9c6f56dc404285f2a5fe98be23cd/users/4e21c673563c4277909faec2f4a9d411/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.661990 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63736154-fcea-425c-84bf-ebb8e2402270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6c9c6f56dc404285f2a5fe98be23cd, user_id=4e21c673563c4277909faec2f4a9d411, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:01.664897 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63736154-fcea-425c-84bf-ebb8e2402270 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:01.678438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1433/2883] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:41:01 2022] PUT /identity/v3/projects/bd6c9c6f56dc404285f2a5fe98be23cd/users/4e21c673563c4277909faec2f4a9d411/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:01.689333 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f67eef-69ba-4596-8f4d-5cef71890a1a None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.689799 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f67eef-69ba-4596-8f4d-5cef71890a1a None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.689954 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f67eef-69ba-4596-8f4d-5cef71890a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.716951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-06f67eef-69ba-4596-8f4d-5cef71890a1a None None] MFA Rules not processed for user `4e21c673563c4277909faec2f4a9d411`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:01.718196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-06f67eef-69ba-4596-8f4d-5cef71890a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:01.782072 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1451/2884] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:01.791996 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736154-fcea-425c-84bf-ebb8e2402270 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:01.793780 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-63736154-fcea-425c-84bf-ebb8e2402270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:01.838934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:01.852422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736154-fcea-425c-84bf-ebb8e2402270 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:01.856667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b545717-5ec2-4a25-987c-288d77da4bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:01.857822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b545717-5ec2-4a25-987c-288d77da4bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:01.858184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b545717-5ec2-4a25-987c-288d77da4bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:01.858613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b545717-5ec2-4a25-987c-288d77da4bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:01.867801 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b545717-5ec2-4a25-987c-288d77da4bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:01.869221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b545717-5ec2-4a25-987c-288d77da4bf8 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:01.878618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1434/2885] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:07.190725 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f67eef-69ba-4596-8f4d-5cef71890a1a None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:07.251591 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f67eef-69ba-4596-8f4d-5cef71890a1a None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:07.256068 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:07.256698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:07.256995 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:07.257285 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] PATH_INFO: `/v3/users/4e21c673563c4277909faec2f4a9d411` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:07.258407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e21c673563c4277909faec2f4a9d411)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:07.260575 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:07.302193 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:07.307798 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e21c673563c4277909faec2f4a9d411'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.315535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e21c673563c4277909faec2f4a9d411'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.316296 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e21c673563c4277909faec2f4a9d411'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.327933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e21c673563c4277909faec2f4a9d411'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.334710 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e21c673563c4277909faec2f4a9d411'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.340398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1452/2886] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:41:07 2022] DELETE /identity/v3/users/4e21c673563c4277909faec2f4a9d411 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:07.345356 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a83b8-32e3-4ee3-96b9-3920b73cf661 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:07.345810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a83b8-32e3-4ee3-96b9-3920b73cf661 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:07.345929 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a83b8-32e3-4ee3-96b9-3920b73cf661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:07.365173 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-171a83b8-32e3-4ee3-96b9-3920b73cf661 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:07.366407 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-171a83b8-32e3-4ee3-96b9-3920b73cf661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:07.425169 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1435/2887] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 18:41:07.434773 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:07.436180 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:07.493854 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b312d-22ab-447c-a988-c04ce2b35c08 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:07.497530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac68da-7a37-4dec-bc82-6287ddd27d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:07.498143 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac68da-7a37-4dec-bc82-6287ddd27d44 service neutron] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:07.498428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac68da-7a37-4dec-bc82-6287ddd27d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:07.498708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac68da-7a37-4dec-bc82-6287ddd27d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:07.507637 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac68da-7a37-4dec-bc82-6287ddd27d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:07.509051 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac68da-7a37-4dec-bc82-6287ddd27d44 service neutron] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:07.519235 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1453/2888] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:07.788336 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a83b8-32e3-4ee3-96b9-3920b73cf661 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:07.789816 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-171a83b8-32e3-4ee3-96b9-3920b73cf661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:07.806432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a83b8-32e3-4ee3-96b9-3920b73cf661 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:07.811920 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:07.813140 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:07.814304 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:07.814955 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] PATH_INFO: `/v3/projects/bd6c9c6f56dc404285f2a5fe98be23cd` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:07.816176 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6c9c6f56dc404285f2a5fe98be23cd)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:07.818082 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:07.864612 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6c9c6f56dc404285f2a5fe98be23cd', 'request_id': 'req-70284764-3827-458c-bc65-34e93f091f59'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.871988 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6c9c6f56dc404285f2a5fe98be23cd', 'request_id': 'req-70284764-3827-458c-bc65-34e93f091f59'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.878564 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6c9c6f56dc404285f2a5fe98be23cd', 'request_id': 'req-70284764-3827-458c-bc65-34e93f091f59'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.889942 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] The token cache is being invalidate because project bd6c9c6f56dc404285f2a5fe98be23cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81342) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:41:07.890308 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.891469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-70284764-3827-458c-bc65-34e93f091f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:07.892958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1436/2889] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:41:07 2022] DELETE /identity/v3/projects/bd6c9c6f56dc404285f2a5fe98be23cd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:07.897956 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9f3ae-94a3-4669-a533-becdcfb69f85 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:07.898246 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9f3ae-94a3-4669-a533-becdcfb69f85 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:07.898524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9f3ae-94a3-4669-a533-becdcfb69f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:07.919864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-47f9f3ae-94a3-4669-a533-becdcfb69f85 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:07.921158 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-47f9f3ae-94a3-4669-a533-becdcfb69f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:07.986626 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1454/2890] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:07.994669 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6f43-5d47-4206-818d-e02363f1693f None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:07.994965 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6f43-5d47-4206-818d-e02363f1693f None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:07.995241 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6f43-5d47-4206-818d-e02363f1693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.017044 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-885c6f43-5d47-4206-818d-e02363f1693f None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:08.018279 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-885c6f43-5d47-4206-818d-e02363f1693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:08.027115 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1437/2891] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:08.031525 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9f3ae-94a3-4669-a533-becdcfb69f85 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.041532 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9f3ae-94a3-4669-a533-becdcfb69f85 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.046221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed67cd-0781-4103-bef4-b52f5be9aef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.046812 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed67cd-0781-4103-bef4-b52f5be9aef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.047090 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed67cd-0781-4103-bef4-b52f5be9aef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.047359 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed67cd-0781-4103-bef4-b52f5be9aef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.047998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed67cd-0781-4103-bef4-b52f5be9aef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:41:08.048298 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed67cd-0781-4103-bef4-b52f5be9aef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.049914 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed67cd-0781-4103-bef4-b52f5be9aef8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.061631 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1455/2892] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:41:08.066425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6f43-5d47-4206-818d-e02363f1693f None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.076785 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6f43-5d47-4206-818d-e02363f1693f None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.082299 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c1e8f-d5fa-4348-b305-cab29dbc2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.082905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c1e8f-d5fa-4348-b305-cab29dbc2545 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.083184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c1e8f-d5fa-4348-b305-cab29dbc2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.083457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c1e8f-d5fa-4348-b305-cab29dbc2545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.084084 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c1e8f-d5fa-4348-b305-cab29dbc2545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.086003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c1e8f-d5fa-4348-b305-cab29dbc2545 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.113899 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1438/2893] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:41:08 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:41:08.118160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed67cd-0781-4103-bef4-b52f5be9aef8 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.129422 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed67cd-0781-4103-bef4-b52f5be9aef8 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.175767 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:08.191067 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2411c-f228-4aa3-891c-b10d4239b5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.192064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2411c-f228-4aa3-891c-b10d4239b5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.192064 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2411c-f228-4aa3-891c-b10d4239b5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.192362 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2411c-f228-4aa3-891c-b10d4239b5e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.192893 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2411c-f228-4aa3-891c-b10d4239b5e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.195097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2411c-f228-4aa3-891c-b10d4239b5e7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.219341 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1456/2894] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:41:08 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:41:08.223647 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c1e8f-d5fa-4348-b305-cab29dbc2545 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.235151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c1e8f-d5fa-4348-b305-cab29dbc2545 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.239915 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5473b90-fd72-48bf-81b3-fef9393f5a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.240462 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5473b90-fd72-48bf-81b3-fef9393f5a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.240747 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5473b90-fd72-48bf-81b3-fef9393f5a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.241023 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5473b90-fd72-48bf-81b3-fef9393f5a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.242003 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5473b90-fd72-48bf-81b3-fef9393f5a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.244457 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5473b90-fd72-48bf-81b3-fef9393f5a15 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.255954 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1439/2895] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:08.259873 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2411c-f228-4aa3-891c-b10d4239b5e7 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.270595 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2411c-f228-4aa3-891c-b10d4239b5e7 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.275875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569ef58-cfcf-44f4-a254-e5dec75544b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.275875 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569ef58-cfcf-44f4-a254-e5dec75544b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.276169 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569ef58-cfcf-44f4-a254-e5dec75544b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.276444 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569ef58-cfcf-44f4-a254-e5dec75544b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.277087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569ef58-cfcf-44f4-a254-e5dec75544b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.278802 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569ef58-cfcf-44f4-a254-e5dec75544b7 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.289470 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1457/2896] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:08.294192 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5473b90-fd72-48bf-81b3-fef9393f5a15 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.304714 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5473b90-fd72-48bf-81b3-fef9393f5a15 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.309331 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569719d4-1326-4c9b-8545-8b511efdfd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.309985 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569719d4-1326-4c9b-8545-8b511efdfd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.310266 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569719d4-1326-4c9b-8545-8b511efdfd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.310543 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569719d4-1326-4c9b-8545-8b511efdfd45 admin admin] PATH_INFO: `/v3/projects/67911adf721c45ec869c45d1d08bd1b3/users/4184c75370c8437dba46f4f6cc8dd159/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.325503 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569719d4-1326-4c9b-8545-8b511efdfd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67911adf721c45ec869c45d1d08bd1b3, user_id=4184c75370c8437dba46f4f6cc8dd159, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.328184 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569719d4-1326-4c9b-8545-8b511efdfd45 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.341008 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1440/2897] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:41:08 2022] PUT /identity/v3/projects/67911adf721c45ec869c45d1d08bd1b3/users/4184c75370c8437dba46f4f6cc8dd159/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:41:08.407805 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cdc24-4208-499f-b83b-428518cacf45 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.408199 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cdc24-4208-499f-b83b-428518cacf45 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.408468 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cdc24-4208-499f-b83b-428518cacf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.436667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-220cdc24-4208-499f-b83b-428518cacf45 None None] MFA Rules not processed for user `4184c75370c8437dba46f4f6cc8dd159`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:08.438496 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-220cdc24-4208-499f-b83b-428518cacf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:08.506654 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1458/2898] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:08.511373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569719d4-1326-4c9b-8545-8b511efdfd45 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.517007 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:08.586727 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569719d4-1326-4c9b-8545-8b511efdfd45 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.591381 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b8b1e-f88d-4cfb-a2a8-a05210f798db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.591993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b8b1e-f88d-4cfb-a2a8-a05210f798db admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.592280 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b8b1e-f88d-4cfb-a2a8-a05210f798db admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.592557 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b8b1e-f88d-4cfb-a2a8-a05210f798db admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.593190 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b8b1e-f88d-4cfb-a2a8-a05210f798db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.595626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b8b1e-f88d-4cfb-a2a8-a05210f798db admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.622357 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1441/2899] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:41:08 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:41:08.626485 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cdc24-4208-499f-b83b-428518cacf45 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.637275 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cdc24-4208-499f-b83b-428518cacf45 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.693100 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f7c52-e41d-47b3-94df-eda43bc0b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.693742 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f7c52-e41d-47b3-94df-eda43bc0b4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.694026 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f7c52-e41d-47b3-94df-eda43bc0b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.694299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f7c52-e41d-47b3-94df-eda43bc0b4fd admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.694925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f7c52-e41d-47b3-94df-eda43bc0b4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.696820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f7c52-e41d-47b3-94df-eda43bc0b4fd admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.717098 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1459/2900] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:41:08 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:41:08.721585 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b8b1e-f88d-4cfb-a2a8-a05210f798db admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.731626 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b8b1e-f88d-4cfb-a2a8-a05210f798db admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.736893 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b19ac-79ce-4ccf-9d28-06621fbe33f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.737525 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b19ac-79ce-4ccf-9d28-06621fbe33f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.737810 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b19ac-79ce-4ccf-9d28-06621fbe33f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.738086 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b19ac-79ce-4ccf-9d28-06621fbe33f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.738726 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b19ac-79ce-4ccf-9d28-06621fbe33f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.740311 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b19ac-79ce-4ccf-9d28-06621fbe33f2 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.750600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1442/2901] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:08.754291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f7c52-e41d-47b3-94df-eda43bc0b4fd admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.764923 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f7c52-e41d-47b3-94df-eda43bc0b4fd admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.769507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428023a7-e5f9-4e47-8143-dabbca6a5645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.770110 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428023a7-e5f9-4e47-8143-dabbca6a5645 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.770396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428023a7-e5f9-4e47-8143-dabbca6a5645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.770673 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428023a7-e5f9-4e47-8143-dabbca6a5645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.771316 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428023a7-e5f9-4e47-8143-dabbca6a5645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.772904 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428023a7-e5f9-4e47-8143-dabbca6a5645 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.783278 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1460/2902] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:08.787210 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b19ac-79ce-4ccf-9d28-06621fbe33f2 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:08.797812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b19ac-79ce-4ccf-9d28-06621fbe33f2 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:08.802374 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfc48e-7041-436e-8283-7ff2ada576c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:08.803016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc48e-7041-436e-8283-7ff2ada576c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.803298 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc48e-7041-436e-8283-7ff2ada576c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.803569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc48e-7041-436e-8283-7ff2ada576c3 admin admin] PATH_INFO: `/v3/projects/22c86eaae8394f6395c8e43d3b3130d7/users/6103e9132454438e93fcac48b4b3ea8b/roles/7c59786364c04f0087154923c39fa449` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.817667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfc48e-7041-436e-8283-7ff2ada576c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c86eaae8394f6395c8e43d3b3130d7, user_id=6103e9132454438e93fcac48b4b3ea8b, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:08.820260 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfc48e-7041-436e-8283-7ff2ada576c3 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:08.832762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1443/2903] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:41:08 2022] PUT /identity/v3/projects/22c86eaae8394f6395c8e43d3b3130d7/users/6103e9132454438e93fcac48b4b3ea8b/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:08.842442 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a221d8-6430-44db-abd3-3891894ea3ea None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:08.842726 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a221d8-6430-44db-abd3-3891894ea3ea None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:08.843020 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a221d8-6430-44db-abd3-3891894ea3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:08.876179 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-f3a221d8-6430-44db-abd3-3891894ea3ea None None] MFA Rules not processed for user `6103e9132454438e93fcac48b4b3ea8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:08.877434 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f3a221d8-6430-44db-abd3-3891894ea3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:08.901663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:08.943579 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1461/2904] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:08.948148 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfc48e-7041-436e-8283-7ff2ada576c3 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:09.008675 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfc48e-7041-436e-8283-7ff2ada576c3 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:09.013618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc400dff-e749-4047-bad7-dd455b8d510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:09.014221 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400dff-e749-4047-bad7-dd455b8d510c admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:09.014504 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400dff-e749-4047-bad7-dd455b8d510c admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:09.014782 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400dff-e749-4047-bad7-dd455b8d510c admin admin] PATH_INFO: `/v3/projects` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:09.015958 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc400dff-e749-4047-bad7-dd455b8d510c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:09.017824 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc400dff-e749-4047-bad7-dd455b8d510c admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:09.044099 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1444/2905] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:41:08 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:41:09.048192 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a221d8-6430-44db-abd3-3891894ea3ea None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:09.059112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a221d8-6430-44db-abd3-3891894ea3ea None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:09.115549 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22672a3-5748-4126-b202-364988454736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:09.116146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22672a3-5748-4126-b202-364988454736 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:09.116426 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22672a3-5748-4126-b202-364988454736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:09.116695 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22672a3-5748-4126-b202-364988454736 admin admin] PATH_INFO: `/v3/users` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:09.117349 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22672a3-5748-4126-b202-364988454736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:09.119242 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22672a3-5748-4126-b202-364988454736 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:09.141711 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1462/2906] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:41:09 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:41:09.145670 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc400dff-e749-4047-bad7-dd455b8d510c admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:09.155602 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc400dff-e749-4047-bad7-dd455b8d510c admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:09.164040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8f3a-da26-45e9-82b7-b10d33a59f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:09.164040 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8f3a-da26-45e9-82b7-b10d33a59f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:09.164300 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8f3a-da26-45e9-82b7-b10d33a59f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:09.164598 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8f3a-da26-45e9-82b7-b10d33a59f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:09.165448 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d8f3a-da26-45e9-82b7-b10d33a59f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:09.167238 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d8f3a-da26-45e9-82b7-b10d33a59f2e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:09.178068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1445/2907] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:09.182312 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22672a3-5748-4126-b202-364988454736 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:09.192264 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22672a3-5748-4126-b202-364988454736 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:09.197124 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96265213-6d33-48fb-993b-34571017ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:09.197863 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96265213-6d33-48fb-993b-34571017ab23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:09.198148 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96265213-6d33-48fb-993b-34571017ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:09.198429 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96265213-6d33-48fb-993b-34571017ab23 admin admin] PATH_INFO: `/v3/projects/8a9b1a2178ce46b9a5f7469153c666e4/users/c5e902959bd2434d9a059685f2803295/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:09.213917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96265213-6d33-48fb-993b-34571017ab23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9b1a2178ce46b9a5f7469153c666e4, user_id=c5e902959bd2434d9a059685f2803295, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:09.218334 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96265213-6d33-48fb-993b-34571017ab23 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:09.235087 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1463/2908] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:41:09 2022] PUT /identity/v3/projects/8a9b1a2178ce46b9a5f7469153c666e4/users/c5e902959bd2434d9a059685f2803295/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:09.239270 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8f3a-da26-45e9-82b7-b10d33a59f2e admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:09.250554 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8f3a-da26-45e9-82b7-b10d33a59f2e admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:09.278473 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:09.309843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480392b1-0117-4c66-a241-ce9671c4ad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:09.310445 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480392b1-0117-4c66-a241-ce9671c4ad5b admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:09.310721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480392b1-0117-4c66-a241-ce9671c4ad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:09.310991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480392b1-0117-4c66-a241-ce9671c4ad5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:09.311610 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480392b1-0117-4c66-a241-ce9671c4ad5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:09.313715 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480392b1-0117-4c66-a241-ce9671c4ad5b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:09.323157 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1446/2909] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:09.327409 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96265213-6d33-48fb-993b-34571017ab23 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:09.338198 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96265213-6d33-48fb-993b-34571017ab23 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:09.342752 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5551-7ac6-4be6-9fb3-035497a44e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:09.343398 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5551-7ac6-4be6-9fb3-035497a44e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:09.343681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5551-7ac6-4be6-9fb3-035497a44e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:09.343957 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5551-7ac6-4be6-9fb3-035497a44e81 admin admin] PATH_INFO: `/v3/projects/8a9b1a2178ce46b9a5f7469153c666e4/users/c5e902959bd2434d9a059685f2803295/roles/896af79d4273418bbc5535435dd0d6b6` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:09.345864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e5551-7ac6-4be6-9fb3-035497a44e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9b1a2178ce46b9a5f7469153c666e4, user_id=c5e902959bd2434d9a059685f2803295, role_id=896af79d4273418bbc5535435dd0d6b6)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:09.348459 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e5551-7ac6-4be6-9fb3-035497a44e81 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:09.358423 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1464/2910] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:41:09 2022] PUT /identity/v3/projects/8a9b1a2178ce46b9a5f7469153c666e4/users/c5e902959bd2434d9a059685f2803295/roles/896af79d4273418bbc5535435dd0d6b6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:09.368255 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bd878-8d45-4b10-8430-658edefa0359 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:09.368540 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bd878-8d45-4b10-8430-658edefa0359 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:09.368812 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bd878-8d45-4b10-8430-658edefa0359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:09.397697 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-324bd878-8d45-4b10-8430-658edefa0359 None None] MFA Rules not processed for user `c5e902959bd2434d9a059685f2803295`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:09.398881 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-324bd878-8d45-4b10-8430-658edefa0359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:09.465181 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1447/2911] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:09.476350 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5551-7ac6-4be6-9fb3-035497a44e81 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:09.478112 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8f1e5551-7ac6-4be6-9fb3-035497a44e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:09.536336 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5551-7ac6-4be6-9fb3-035497a44e81 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:09.539933 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ddb79-2d8e-4a1c-8c28-9ab2bf35f843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:09.540535 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ddb79-2d8e-4a1c-8c28-9ab2bf35f843 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:09.540824 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ddb79-2d8e-4a1c-8c28-9ab2bf35f843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:09.541102 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ddb79-2d8e-4a1c-8c28-9ab2bf35f843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:09.570925 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:09.598428 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ddb79-2d8e-4a1c-8c28-9ab2bf35f843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:09.599857 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ddb79-2d8e-4a1c-8c28-9ab2bf35f843 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:09.608563 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1465/2912] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:11.110455 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bd878-8d45-4b10-8430-658edefa0359 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:11.111853 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-324bd878-8d45-4b10-8430-658edefa0359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:11.123688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bd878-8d45-4b10-8430-658edefa0359 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:11.128162 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15253ec6-8040-4c20-9e54-067e2595b718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:11.128767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15253ec6-8040-4c20-9e54-067e2595b718 service cinder] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:11.129047 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15253ec6-8040-4c20-9e54-067e2595b718 service cinder] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:11.129350 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15253ec6-8040-4c20-9e54-067e2595b718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:11.183953 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15253ec6-8040-4c20-9e54-067e2595b718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:11.185342 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15253ec6-8040-4c20-9e54-067e2595b718 service cinder] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:11.194567 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1448/2913] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:11.741223 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ddb79-2d8e-4a1c-8c28-9ab2bf35f843 service cinder] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:11.750129 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ddb79-2d8e-4a1c-8c28-9ab2bf35f843 service cinder] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:11.753683 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64b44d-7774-4ea3-90fa-67d033e7d092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:11.754280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b44d-7774-4ea3-90fa-67d033e7d092 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:11.754559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b44d-7774-4ea3-90fa-67d033e7d092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:11.754828 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b44d-7774-4ea3-90fa-67d033e7d092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:11.763765 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64b44d-7774-4ea3-90fa-67d033e7d092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:11.765170 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64b44d-7774-4ea3-90fa-67d033e7d092 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:11.774670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1466/2914] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:15.643126 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15253ec6-8040-4c20-9e54-067e2595b718 service cinder] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:15.693151 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=100 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:15.708067 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15253ec6-8040-4c20-9e54-067e2595b718 service cinder] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:15.712630 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:15.713302 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:15.713589 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:15.713870 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] PATH_INFO: `/v3/users/4184c75370c8437dba46f4f6cc8dd159` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:15.714983 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4184c75370c8437dba46f4f6cc8dd159)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:15.716888 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:15.762240 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4184c75370c8437dba46f4f6cc8dd159'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:15.770104 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4184c75370c8437dba46f4f6cc8dd159'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:15.770733 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4184c75370c8437dba46f4f6cc8dd159'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:15.783367 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4184c75370c8437dba46f4f6cc8dd159'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:15.790491 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4184c75370c8437dba46f4f6cc8dd159'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:15.796303 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1449/2915] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:41:15 2022] DELETE /identity/v3/users/4184c75370c8437dba46f4f6cc8dd159 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:15.801116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b534eac-f6e4-4caa-8f0a-27b30ea7a192 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:15.801622 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b534eac-f6e4-4caa-8f0a-27b30ea7a192 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:15.801760 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b534eac-f6e4-4caa-8f0a-27b30ea7a192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:15.821363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-8b534eac-f6e4-4caa-8f0a-27b30ea7a192 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:15.822565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8b534eac-f6e4-4caa-8f0a-27b30ea7a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:15.879716 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1467/2916] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:15.889732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:15.891640 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:15.948559 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39db295-b4a0-4a4c-8e67-b91f73664b35 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:15.952438 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c204e-c240-4255-9fe9-474c5d652702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:15.953710 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c204e-c240-4255-9fe9-474c5d652702 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:15.953992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c204e-c240-4255-9fe9-474c5d652702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:15.954267 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c204e-c240-4255-9fe9-474c5d652702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:15.963425 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c204e-c240-4255-9fe9-474c5d652702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:15.964843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c204e-c240-4255-9fe9-474c5d652702 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:15.974740 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1450/2917] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:16.241965 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b534eac-f6e4-4caa-8f0a-27b30ea7a192 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:16.243384 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-8b534eac-f6e4-4caa-8f0a-27b30ea7a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:16.255652 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b534eac-f6e4-4caa-8f0a-27b30ea7a192 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:16.260323 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:16.261221 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:16.261530 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:16.261806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] PATH_INFO: `/v3/projects/67911adf721c45ec869c45d1d08bd1b3` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:16.262921 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67911adf721c45ec869c45d1d08bd1b3)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:16.264823 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:16.314471 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67911adf721c45ec869c45d1d08bd1b3', 'request_id': 'req-2d241fdf-5a3b-4190-bd65-62bbe908d594'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.320697 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67911adf721c45ec869c45d1d08bd1b3', 'request_id': 'req-2d241fdf-5a3b-4190-bd65-62bbe908d594'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.326299 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67911adf721c45ec869c45d1d08bd1b3', 'request_id': 'req-2d241fdf-5a3b-4190-bd65-62bbe908d594'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.338847 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] The token cache is being invalidate because project 67911adf721c45ec869c45d1d08bd1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:41:16.339137 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.339759 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.341441 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1468/2918] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:41:16 2022] DELETE /identity/v3/projects/67911adf721c45ec869c45d1d08bd1b3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:16.345290 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c204e-c240-4255-9fe9-474c5d652702 service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:16.354891 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c204e-c240-4255-9fe9-474c5d652702 service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:16.412651 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:16.413310 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:16.413600 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:16.413879 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] PATH_INFO: `/v3/users/6103e9132454438e93fcac48b4b3ea8b` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:16.415000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6103e9132454438e93fcac48b4b3ea8b)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:16.416910 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:16.429029 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:16.465107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6103e9132454438e93fcac48b4b3ea8b'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.472472 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6103e9132454438e93fcac48b4b3ea8b'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.473105 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6103e9132454438e93fcac48b4b3ea8b'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.485618 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6103e9132454438e93fcac48b4b3ea8b'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.492732 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6103e9132454438e93fcac48b4b3ea8b'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.498762 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1451/2919] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:41:16 2022] DELETE /identity/v3/users/6103e9132454438e93fcac48b4b3ea8b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:16.766175 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:16.767667 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:16.780728 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d241fdf-5a3b-4190-bd65-62bbe908d594 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:16.822402 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:16.840163 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:16.840796 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:16.841080 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:16.841396 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] PATH_INFO: `/v3/projects/22c86eaae8394f6395c8e43d3b3130d7` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:16.842507 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c86eaae8394f6395c8e43d3b3130d7)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:16.844942 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:16.891886 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c86eaae8394f6395c8e43d3b3130d7', 'request_id': 'req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.898406 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c86eaae8394f6395c8e43d3b3130d7', 'request_id': 'req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.904032 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c86eaae8394f6395c8e43d3b3130d7', 'request_id': 'req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.916939 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] The token cache is being invalidate because project 22c86eaae8394f6395c8e43d3b3130d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:41:16.917257 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.917889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:16.919356 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1469/2920] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:41:16 2022] DELETE /identity/v3/projects/22c86eaae8394f6395c8e43d3b3130d7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:41:16.924024 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:16.925518 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:16.938226 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f93fe-a61e-4f53-a571-bfc4b63f565b admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:16.994594 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:16.995230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:16.995516 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:16.995798 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] PATH_INFO: `/v3/users/c5e902959bd2434d9a059685f2803295` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:16.996905 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e902959bd2434d9a059685f2803295)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:16.998878 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:17.043741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e902959bd2434d9a059685f2803295'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.052565 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e902959bd2434d9a059685f2803295'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.053204 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e902959bd2434d9a059685f2803295'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.065000 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e902959bd2434d9a059685f2803295'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.071854 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-96612f2b-a21d-4943-8e87-89dd7ff34fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e902959bd2434d9a059685f2803295'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.077728 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1452/2921] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:41:16 2022] DELETE /identity/v3/users/c5e902959bd2434d9a059685f2803295 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:17.349835 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:17.351291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:17.364368 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca467d2-32ab-42e0-b745-d5aa0d690ec1 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:17.422866 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:17.423510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.423820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.424097 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] PATH_INFO: `/v3/projects/8a9b1a2178ce46b9a5f7469153c666e4` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.425300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9b1a2178ce46b9a5f7469153c666e4)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:17.427146 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:17.472559 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9b1a2178ce46b9a5f7469153c666e4', 'request_id': 'req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.478842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9b1a2178ce46b9a5f7469153c666e4', 'request_id': 'req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.484363 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9b1a2178ce46b9a5f7469153c666e4', 'request_id': 'req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.496516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] The token cache is being invalidate because project 8a9b1a2178ce46b9a5f7469153c666e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:41:17.496806 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.497489 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-b8fe5f96-c86d-4acd-9ec1-a343bbd49319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:17.498963 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1470/2922] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:41:17 2022] DELETE /identity/v3/projects/8a9b1a2178ce46b9a5f7469153c666e4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:17.505396 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5621ca8-24ea-434a-aa29-dcfe0f16d3ee None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.505685 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5621ca8-24ea-434a-aa29-dcfe0f16d3ee None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.505959 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5621ca8-24ea-434a-aa29-dcfe0f16d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.526041 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-b5621ca8-24ea-434a-aa29-dcfe0f16d3ee None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:17.527235 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-b5621ca8-24ea-434a-aa29-dcfe0f16d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:17.531993 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:17.587177 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1453/2923] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:17.595006 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f84a5-dc06-4530-ab8b-a3c333eb4f2c None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.595291 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f84a5-dc06-4530-ab8b-a3c333eb4f2c None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.595562 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f84a5-dc06-4530-ab8b-a3c333eb4f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.603491 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:17.617703 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-b42f84a5-dc06-4530-ab8b-a3c333eb4f2c None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:17.618895 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-b42f84a5-dc06-4530-ab8b-a3c333eb4f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:17.627116 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1471/2924] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:17.631237 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5621ca8-24ea-434a-aa29-dcfe0f16d3ee None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:17.641576 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5621ca8-24ea-434a-aa29-dcfe0f16d3ee None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:17.646063 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205078bc-da76-4ae4-8ada-5e20c0b05593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:17.646657 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205078bc-da76-4ae4-8ada-5e20c0b05593 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.646934 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205078bc-da76-4ae4-8ada-5e20c0b05593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.647207 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205078bc-da76-4ae4-8ada-5e20c0b05593 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.647843 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205078bc-da76-4ae4-8ada-5e20c0b05593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:41:17.648145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205078bc-da76-4ae4-8ada-5e20c0b05593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:17.649765 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205078bc-da76-4ae4-8ada-5e20c0b05593 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:17.661333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1454/2925] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:41:17.665488 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f84a5-dc06-4530-ab8b-a3c333eb4f2c None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:17.674880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f84a5-dc06-4530-ab8b-a3c333eb4f2c None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:17.680181 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571944f3-9e1c-48e4-8ce0-c48d9d2321b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:17.680784 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571944f3-9e1c-48e4-8ce0-c48d9d2321b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.681063 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571944f3-9e1c-48e4-8ce0-c48d9d2321b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.681364 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571944f3-9e1c-48e4-8ce0-c48d9d2321b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.681998 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571944f3-9e1c-48e4-8ce0-c48d9d2321b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:17.683864 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571944f3-9e1c-48e4-8ce0-c48d9d2321b8 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:17.711681 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1472/2926] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:41:17 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 18:41:17.716091 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205078bc-da76-4ae4-8ada-5e20c0b05593 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:17.726064 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205078bc-da76-4ae4-8ada-5e20c0b05593 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:17.781079 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e639656-44e1-4179-8999-dddc67de2093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:17.781731 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e639656-44e1-4179-8999-dddc67de2093 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.782012 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e639656-44e1-4179-8999-dddc67de2093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.782287 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e639656-44e1-4179-8999-dddc67de2093 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.782919 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e639656-44e1-4179-8999-dddc67de2093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:17.784849 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e639656-44e1-4179-8999-dddc67de2093 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:17.805422 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1455/2927] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:41:17 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:41:17.809670 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571944f3-9e1c-48e4-8ce0-c48d9d2321b8 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:17.820373 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571944f3-9e1c-48e4-8ce0-c48d9d2321b8 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:17.824872 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3166b-2f02-4a08-ab36-691a5d8bfa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:17.825484 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3166b-2f02-4a08-ab36-691a5d8bfa7d admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.825761 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3166b-2f02-4a08-ab36-691a5d8bfa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.826029 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3166b-2f02-4a08-ab36-691a5d8bfa7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.826663 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3166b-2f02-4a08-ab36-691a5d8bfa7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:17.828840 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3166b-2f02-4a08-ab36-691a5d8bfa7d admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:17.838524 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1473/2928] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:17.842370 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e639656-44e1-4179-8999-dddc67de2093 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:17.852542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e639656-44e1-4179-8999-dddc67de2093 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:17.857201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d35af-222a-491b-af1e-c31a54a72dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:17.857862 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d35af-222a-491b-af1e-c31a54a72dec admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.858153 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d35af-222a-491b-af1e-c31a54a72dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.858432 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d35af-222a-491b-af1e-c31a54a72dec admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.859117 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d35af-222a-491b-af1e-c31a54a72dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:17.860700 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d35af-222a-491b-af1e-c31a54a72dec admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:17.871197 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1456/2929] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 18:41:17.875780 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3166b-2f02-4a08-ab36-691a5d8bfa7d admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:17.886101 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3166b-2f02-4a08-ab36-691a5d8bfa7d admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:17.891310 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ee55-acf2-4f3d-b83d-49f01cfb99e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:17.891969 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ee55-acf2-4f3d-b83d-49f01cfb99e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.892254 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ee55-acf2-4f3d-b83d-49f01cfb99e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.892565 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ee55-acf2-4f3d-b83d-49f01cfb99e6 admin admin] PATH_INFO: `/v3/projects/0fd0587099fe410cbbeb8de1010c694c/users/8c27cc6ea3184a55807a28c01dd0e269/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.907145 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797ee55-acf2-4f3d-b83d-49f01cfb99e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd0587099fe410cbbeb8de1010c694c, user_id=8c27cc6ea3184a55807a28c01dd0e269, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:17.909844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797ee55-acf2-4f3d-b83d-49f01cfb99e6 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:17.922542 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1474/2930] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:41:17 2022] PUT /identity/v3/projects/0fd0587099fe410cbbeb8de1010c694c/users/8c27cc6ea3184a55807a28c01dd0e269/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:17.932850 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704a71-98e0-486a-835c-5a6f53ff7519 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:17.933333 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704a71-98e0-486a-835c-5a6f53ff7519 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:17.933434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704a71-98e0-486a-835c-5a6f53ff7519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:17.961447 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-85704a71-98e0-486a-835c-5a6f53ff7519 None None] MFA Rules not processed for user `8c27cc6ea3184a55807a28c01dd0e269`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:17.962702 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-85704a71-98e0-486a-835c-5a6f53ff7519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:18.027992 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1457/2931] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:18.039880 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ee55-acf2-4f3d-b83d-49f01cfb99e6 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:18.041662 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-f797ee55-acf2-4f3d-b83d-49f01cfb99e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:18.119323 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ee55-acf2-4f3d-b83d-49f01cfb99e6 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:18.122959 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44435de-e358-4fe0-b5f2-72248d165d0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab45d09f8724d9ca5b6fb1fa050fdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:18.123564 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44435de-e358-4fe0-b5f2-72248d165d0b service glance] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:18.123844 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44435de-e358-4fe0-b5f2-72248d165d0b service glance] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:18.124118 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44435de-e358-4fe0-b5f2-72248d165d0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:18.132793 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44435de-e358-4fe0-b5f2-72248d165d0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:18.134229 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44435de-e358-4fe0-b5f2-72248d165d0b service glance] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:18.143186 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1475/2932] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:28.025093 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:28.139715 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=61,keystone:INSERT=2 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:45.165172 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704a71-98e0-486a-835c-5a6f53ff7519 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:45.226275 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704a71-98e0-486a-835c-5a6f53ff7519 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:45.230806 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:45.231434 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:45.231721 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:45.231998 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] PATH_INFO: `/v3/users/8c27cc6ea3184a55807a28c01dd0e269` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:45.233111 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c27cc6ea3184a55807a28c01dd0e269)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:45.235052 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:45.283593 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c27cc6ea3184a55807a28c01dd0e269'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.291101 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c27cc6ea3184a55807a28c01dd0e269'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.291741 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c27cc6ea3184a55807a28c01dd0e269'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.304332 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c27cc6ea3184a55807a28c01dd0e269'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.311189 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c27cc6ea3184a55807a28c01dd0e269'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.317524 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1458/2933] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:41:45 2022] DELETE /identity/v3/users/8c27cc6ea3184a55807a28c01dd0e269 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:45.322105 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4acd38-edbb-4a2b-a65b-44e694c35437 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:45.322653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4acd38-edbb-4a2b-a65b-44e694c35437 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:45.322653 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4acd38-edbb-4a2b-a65b-44e694c35437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:45.341445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-7b4acd38-edbb-4a2b-a65b-44e694c35437 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:45.342650 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7b4acd38-edbb-4a2b-a65b-44e694c35437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:45.401187 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1476/2934] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:45.410698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:45.412613 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:45.470006 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adad52-c9aa-458d-90ca-82d9ffddd047 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:45.473900 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713a335-982a-4c4d-ae15-f7eae90e8563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:45.475057 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713a335-982a-4c4d-ae15-f7eae90e8563 service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:45.475345 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713a335-982a-4c4d-ae15-f7eae90e8563 service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:45.475646 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713a335-982a-4c4d-ae15-f7eae90e8563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:45.484667 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713a335-982a-4c4d-ae15-f7eae90e8563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:45.486119 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713a335-982a-4c4d-ae15-f7eae90e8563 service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:45.495937 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1459/2935] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:45.762866 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4acd38-edbb-4a2b-a65b-44e694c35437 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:45.764300 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-7b4acd38-edbb-4a2b-a65b-44e694c35437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:45.776132 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4acd38-edbb-4a2b-a65b-44e694c35437 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:45.780707 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:45.781370 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:45.781656 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:45.781932 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] PATH_INFO: `/v3/projects/0fd0587099fe410cbbeb8de1010c694c` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:45.783141 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd0587099fe410cbbeb8de1010c694c)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:45.785043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:45.831233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd0587099fe410cbbeb8de1010c694c', 'request_id': 'req-a216e0b3-007a-438a-88fd-06b06fdacb7e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.837424 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd0587099fe410cbbeb8de1010c694c', 'request_id': 'req-a216e0b3-007a-438a-88fd-06b06fdacb7e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.842951 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd0587099fe410cbbeb8de1010c694c', 'request_id': 'req-a216e0b3-007a-438a-88fd-06b06fdacb7e'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.855510 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] The token cache is being invalidate because project 0fd0587099fe410cbbeb8de1010c694c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:41:45.855803 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.856430 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-a216e0b3-007a-438a-88fd-06b06fdacb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:45.858136 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1477/2936] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:41:45 2022] DELETE /identity/v3/projects/0fd0587099fe410cbbeb8de1010c694c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 18:41:45.862906 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb263d07-b449-4513-be8b-149ac83e2a7d None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:45.863193 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb263d07-b449-4513-be8b-149ac83e2a7d None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:45.863469 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb263d07-b449-4513-be8b-149ac83e2a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:45.883764 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-bb263d07-b449-4513-be8b-149ac83e2a7d None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:45.884943 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-bb263d07-b449-4513-be8b-149ac83e2a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:45.901428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:45.949760 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1460/2937] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:45.952917 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619da12-2be2-43f6-b31d-7815559a5245 None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:45.953282 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619da12-2be2-43f6-b31d-7815559a5245 None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:45.953571 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619da12-2be2-43f6-b31d-7815559a5245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:45.973340 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4619da12-2be2-43f6-b31d-7815559a5245 None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:45.975031 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4619da12-2be2-43f6-b31d-7815559a5245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:45.982891 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1478/2938] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:45.987050 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb263d07-b449-4513-be8b-149ac83e2a7d None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:45.997547 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb263d07-b449-4513-be8b-149ac83e2a7d None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:46.002321 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37993-2156-4738-a387-fb0a1073bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:46.002926 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37993-2156-4738-a387-fb0a1073bd25 admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:46.003211 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37993-2156-4738-a387-fb0a1073bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:46.003483 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37993-2156-4738-a387-fb0a1073bd25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:46.004124 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d37993-2156-4738-a387-fb0a1073bd25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81342) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 18:41:46.004458 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d37993-2156-4738-a387-fb0a1073bd25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:46.006078 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d37993-2156-4738-a387-fb0a1073bd25 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:46.017822 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1461/2939] 10.222.0.61 () {58 vars in 1153 bytes} [Thu Sep 22 18:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 18:41:46.021982 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619da12-2be2-43f6-b31d-7815559a5245 None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:46.031069 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619da12-2be2-43f6-b31d-7815559a5245 None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:46.035641 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db02c6b-ea7a-4cdf-873c-661a69a23554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:46.036233 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db02c6b-ea7a-4cdf-873c-661a69a23554 admin admin] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:46.036516 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db02c6b-ea7a-4cdf-873c-661a69a23554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:46.036785 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db02c6b-ea7a-4cdf-873c-661a69a23554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:46.037962 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db02c6b-ea7a-4cdf-873c-661a69a23554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:46.039842 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db02c6b-ea7a-4cdf-873c-661a69a23554 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:46.066302 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1479/2940] 10.222.0.61 () {60 vars in 1153 bytes} [Thu Sep 22 18:41:46 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:41:46.070832 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37993-2156-4738-a387-fb0a1073bd25 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:46.080671 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37993-2156-4738-a387-fb0a1073bd25 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:46.137386 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7875678-c251-49c5-97d2-bcac3f6956f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:46.137991 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7875678-c251-49c5-97d2-bcac3f6956f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:46.138273 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7875678-c251-49c5-97d2-bcac3f6956f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:46.138542 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7875678-c251-49c5-97d2-bcac3f6956f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:46.139164 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7875678-c251-49c5-97d2-bcac3f6956f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:46.141062 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7875678-c251-49c5-97d2-bcac3f6956f7 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:46.162449 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1462/2941] 10.222.0.61 () {60 vars in 1144 bytes} [Thu Sep 22 18:41:46 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 18:41:46.166583 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db02c6b-ea7a-4cdf-873c-661a69a23554 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:46.176747 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db02c6b-ea7a-4cdf-873c-661a69a23554 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:46.182085 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884882fc-c7ef-485e-bae1-89cf12ad3a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:46.182686 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884882fc-c7ef-485e-bae1-89cf12ad3a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:46.182971 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884882fc-c7ef-485e-bae1-89cf12ad3a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:46.183247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884882fc-c7ef-485e-bae1-89cf12ad3a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:46.183889 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884882fc-c7ef-485e-bae1-89cf12ad3a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:46.185513 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884882fc-c7ef-485e-bae1-89cf12ad3a93 admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:46.195196 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1480/2942] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:46.198817 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7875678-c251-49c5-97d2-bcac3f6956f7 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:46.208712 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7875678-c251-49c5-97d2-bcac3f6956f7 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:46.213418 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501ac4e-5290-4a52-a020-5f1978226a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:46.214016 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501ac4e-5290-4a52-a020-5f1978226a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:46.214296 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501ac4e-5290-4a52-a020-5f1978226a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:46.214568 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501ac4e-5290-4a52-a020-5f1978226a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:46.215201 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501ac4e-5290-4a52-a020-5f1978226a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:46.216866 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501ac4e-5290-4a52-a020-5f1978226a7e admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:46.227979 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1463/2943] 10.222.0.61 () {58 vars in 1122 bytes} [Thu Sep 22 18:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 18:41:46.232037 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884882fc-c7ef-485e-bae1-89cf12ad3a93 admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:46.242610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884882fc-c7ef-485e-bae1-89cf12ad3a93 admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:46.247421 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6603-ec36-4e18-826c-bb9c0396e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:46.248084 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6603-ec36-4e18-826c-bb9c0396e30e admin admin] REQUEST_METHOD: `PUT` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:46.248394 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6603-ec36-4e18-826c-bb9c0396e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:46.248708 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6603-ec36-4e18-826c-bb9c0396e30e admin admin] PATH_INFO: `/v3/projects/339dfb147b084ee4bef7431c4028d83b/users/cf62a31cef9d47d3a3da7ac105bea92a/roles/7c59786364c04f0087154923c39fa449` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:46.263329 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b6603-ec36-4e18-826c-bb9c0396e30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=339dfb147b084ee4bef7431c4028d83b, user_id=cf62a31cef9d47d3a3da7ac105bea92a, role_id=7c59786364c04f0087154923c39fa449)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:46.266010 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b6603-ec36-4e18-826c-bb9c0396e30e admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:46.278690 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1481/2944] 10.222.0.61 () {60 vars in 1483 bytes} [Thu Sep 22 18:41:46 2022] PUT /identity/v3/projects/339dfb147b084ee4bef7431c4028d83b/users/cf62a31cef9d47d3a3da7ac105bea92a/roles/7c59786364c04f0087154923c39fa449 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:46.289505 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4384c-f53e-4021-9428-4325c45a2a59 None None] REQUEST_METHOD: `POST` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:46.289793 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4384c-f53e-4021-9428-4325c45a2a59 None None] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:46.290068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4384c-f53e-4021-9428-4325c45a2a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:46.318373 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.auth.core [None req-4af4384c-f53e-4021-9428-4325c45a2a59 None None] MFA Rules not processed for user `cf62a31cef9d47d3a3da7ac105bea92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81342) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:46.319592 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-4af4384c-f53e-4021-9428-4325c45a2a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:46.381840 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1464/2945] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:46.393043 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6603-ec36-4e18-826c-bb9c0396e30e admin admin] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:46.395142 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-6b4b6603-ec36-4e18-826c-bb9c0396e30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:46.417445 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:46.455943 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6603-ec36-4e18-826c-bb9c0396e30e admin admin] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:46.459700 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d8547-5842-496d-b202-9979ea96c251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '465cff05c2ed4fe19e99289379c2966d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:46.460280 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d8547-5842-496d-b202-9979ea96c251 service cinder] REQUEST_METHOD: `GET` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:46.460544 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d8547-5842-496d-b202-9979ea96c251 service cinder] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:46.460820 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d8547-5842-496d-b202-9979ea96c251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:46.469160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d8547-5842-496d-b202-9979ea96c251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:46.470610 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d8547-5842-496d-b202-9979ea96c251 service cinder] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:46.479358 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1482/2946] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:56.378875 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:56.475455 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=17 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:41:56.515107 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4384c-f53e-4021-9428-4325c45a2a59 None None] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:56.576688 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4384c-f53e-4021-9428-4325c45a2a59 None None] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:56.581324 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:56.581952 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:56.582230 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:56.582500 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] PATH_INFO: `/v3/users/cf62a31cef9d47d3a3da7ac105bea92a` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:56.583633 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf62a31cef9d47d3a3da7ac105bea92a)` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:56.585582 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:56.632234 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf62a31cef9d47d3a3da7ac105bea92a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:56.639317 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf62a31cef9d47d3a3da7ac105bea92a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:56.640068 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf62a31cef9d47d3a3da7ac105bea92a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:56.652208 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf62a31cef9d47d3a3da7ac105bea92a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:56.659248 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.notifications [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf62a31cef9d47d3a3da7ac105bea92a'} {{(pid=81342) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:56.667020 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1465/2947] 10.222.0.61 () {58 vars in 1224 bytes} [Thu Sep 22 18:41:56 2022] DELETE /identity/v3/users/cf62a31cef9d47d3a3da7ac105bea92a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:41:56.671687 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f68fe-182b-4067-b4b6-650658b266fa None None] REQUEST_METHOD: `POST` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:56.671974 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f68fe-182b-4067-b4b6-650658b266fa None None] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:56.672247 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f68fe-182b-4067-b4b6-650658b266fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:56.692461 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.auth.core [None req-4a2f68fe-182b-4067-b4b6-650658b266fa None None] MFA Rules not processed for user `049d44343a884314a11942aecf5771ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 18:41:56.693770 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4a2f68fe-182b-4067-b4b6-650658b266fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:56.752407 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1483/2948] 10.222.0.61 () {58 vars in 958 bytes} [Thu Sep 22 18:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 18:41:56.762944 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:56.764446 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:56.822468 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eb5bd-52a9-4277-a928-d7284b8b0013 admin admin] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:56.826145 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a307ee-6e8d-4dd4-968c-44062a39262a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d0b8fc336694043a34f007b78c45c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:56.826753 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a307ee-6e8d-4dd4-968c-44062a39262a service neutron] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:56.827037 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a307ee-6e8d-4dd4-968c-44062a39262a service neutron] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:56.827313 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a307ee-6e8d-4dd4-968c-44062a39262a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:56.836960 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a307ee-6e8d-4dd4-968c-44062a39262a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:56.838428 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a307ee-6e8d-4dd4-968c-44062a39262a service neutron] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:56.847771 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1466/2949] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:41:57.118103 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f68fe-182b-4067-b4b6-650658b266fa None None] Authenticating user token {{(pid=81343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:41:57.119573 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.fernet_utils [None req-4a2f68fe-182b-4067-b4b6-650658b266fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:41:57.132220 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f68fe-182b-4067-b4b6-650658b266fa None None] Validating token access rules against request {{(pid=81343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:41:57.139878 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049d44343a884314a11942aecf5771ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9e60ccd9c384aa09ff28b8a6b6df44b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:41:57.140436 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:41:57.140704 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] SCRIPT_NAME: `/identity` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:41:57.140977 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] PATH_INFO: `/v3/projects/339dfb147b084ee4bef7431c4028d83b` {{(pid=81343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:41:57.142157 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] RBAC: Authorizing `identity:delete_project(project_id=339dfb147b084ee4bef7431c4028d83b)` {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:41:57.144160 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] RBAC: Authorization granted {{(pid=81343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:41:57.195577 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339dfb147b084ee4bef7431c4028d83b', 'request_id': 'req-940005f9-7a03-4409-9266-a6a96b47503c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:57.201698 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339dfb147b084ee4bef7431c4028d83b', 'request_id': 'req-940005f9-7a03-4409-9266-a6a96b47503c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:57.207162 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339dfb147b084ee4bef7431c4028d83b', 'request_id': 'req-940005f9-7a03-4409-9266-a6a96b47503c'} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:57.219543 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] The token cache is being invalidate because project 339dfb147b084ee4bef7431c4028d83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 18:41:57.219834 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:57.220472 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG keystone.notifications [None req-940005f9-7a03-4409-9266-a6a96b47503c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 18:41:57.221968 dv-cinder-858946-1-smb devstack@keystone.service[81343]: [pid: 81343|app: 0|req: 1484/2950] 10.222.0.61 () {58 vars in 1233 bytes} [Thu Sep 22 18:41:57 2022] DELETE /identity/v3/projects/339dfb147b084ee4bef7431c4028d83b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 18:42:06.843607 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:42:07.216325 dv-cinder-858946-1-smb devstack@keystone.service[81343]: DEBUG dbcounter [-] [81343] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 18:44:41.498698 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a307ee-6e8d-4dd4-968c-44062a39262a service neutron] Authenticating user token {{(pid=81342) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 18:44:41.500137 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-64a307ee-6e8d-4dd4-968c-44062a39262a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:44:41.646571 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a307ee-6e8d-4dd4-968c-44062a39262a service neutron] Validating token access rules against request {{(pid=81342) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 18:44:41.705535 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c405de9-1e8e-41d6-9de1-d65116684ef6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e42268a8b5944cbd9508a07c037112e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '834afef9c82248f996e13710c40e7ee3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81342) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 18:44:41.706150 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c405de9-1e8e-41d6-9de1-d65116684ef6 service placement] REQUEST_METHOD: `GET` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 18:44:41.706437 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c405de9-1e8e-41d6-9de1-d65116684ef6 service placement] SCRIPT_NAME: `/identity` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 18:44:41.707353 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c405de9-1e8e-41d6-9de1-d65116684ef6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81342) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 18:44:41.709122 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.fernet_utils [None req-7c405de9-1e8e-41d6-9de1-d65116684ef6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81342) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 18:44:41.720170 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c405de9-1e8e-41d6-9de1-d65116684ef6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 18:44:41.721767 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c405de9-1e8e-41d6-9de1-d65116684ef6 service placement] RBAC: Authorization granted {{(pid=81342) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 18:44:41.731569 dv-cinder-858946-1-smb devstack@keystone.service[81342]: [pid: 81342|app: 0|req: 1467/2951] 10.222.0.61 () {60 vars in 1365 bytes} [Thu Sep 22 18:44:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 18:44:51.727325 dv-cinder-858946-1-smb devstack@keystone.service[81342]: DEBUG dbcounter [-] [81342] Writing DB stats keystone:SELECT=89 {{(pid=81342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}